Job Details

ID #8131312
State New York
City New york city
Full-time
Salary USD TBD TBD
Source Bloomberg
Showed 2021-01-12
Date 2021-01-13
Deadline 2021-03-14
Category Et cetera
Create resume

Senior Big Data Software Engineer - Information Security

New York, New york city 00000 New york city USA

Vacancy expired!

Job Requisition Number: 88166Who we are:Bloomberg runs on data. It's our business and our product. From the biggest banks to the most elite hedge funds, financial institutions need timely, accurate data to capture opportunities and evaluate risk in a dynamic market. In order to provide this level of service and the security required to protect it, the Security Data Platform team provides a platform that transforms petabytes of structured and unstructured data such as text, time series, and events into machine-readable knowledge fueling numerous security focused applications.That's where you come in. Working in a talented multi-disciplinary team, you will be responsible for the research, development, and stability of a new Information security data platform. This role offers the ability to innovate and invent, helping define the technical foundations of this essential platform. Our platform is built on a modern container orchestration, streaming and data storage platforms and provides a working base which information security engineers can quickly perform the analysis and build the tools they need to ensure security of our infrastructure.Our team:The Security Data Platform team is a new team which was established to build a platform supporting the data and analytical needs of Bloomberg’s Information Security organizations. As a member of this new team you will be instrumental in all aspects of building a modern platform for delivering monitoring/alerting, anomaly detection and real-time analysis infrastructure in conjunction with our information security teams.How we give back:This new team will make extensive use of open source software. As part of that, we make a commitment to upstreaming features we'll be developing. Whether pushing bug-fixes upstream, developing new features, giving presentations at conferences and meetups, or collaborating with industry leaders, open source will be at the heart of this team. It's not just something we do in our free time, it is how we work.What's in it for you:You'll have the opportunity to make key technical decisions which will bring this platform into the future. You'll be able to apply your existing knowledge while gaining experience from working with specialists in stream processing, kubernetes, hadoop and information security. You'll have the opportunity to create a meaningful impact on the overall information security capabilities.We’ll trust you to:Lead automation operation, installation, and monitoring of system components in our infrastructure stack

Collaborate with information security personnel to understand their software and data needs, and design solutions to ingest, understand and present security related data

Gather requirements and synthesize software solutions to meet them

Produce developer and operational documentation, and troubleshoot run-time issues

Provide performance analysis and capacity planning for clusters

You’ll need to have:Strong software development skills and ability to multitask in an Agile environment

5+ years experience programming in Java, Scala, Python

5+ years experience working with Big Data technologies such as HDFS, Hadoop, Spark, Hive, HBase, Druid, etc.

5+ years experience working with Apache Kafka or other message queuing systems

Excellent communication skills and the ability to collaborate across teams, manage competing goals and changing priorities in a fast-paced environment

We’d love to see:Experience working with/in containerized environments using Docker, Kubernetes, Swarm, Rancher, Mesos

Experience with OSQuery, Santa, sysmon

Experience writing parsers/schemas for semi-structured and unstructured content

Experience with Elasticsearch, Solr, Cassandra and other database technologies

Experience working with authentication and authorization systems such as Kerberos and LDAP

Open source involvement such as a well-curated blog, accepted contribution, or community presence

Machine Learning applied to security use cases

If this sounds like you, apply! You can also learn more about our work using the links below:http://www.bloomberg.com/company/announcements/open-source-bloomberg-solr-work-enhance-enterprise-search/

http://www.bloomberg.com/company/announcements/open-source-at-bloomberg-expanding-our-engagement-with-solr/

http://www.bloomberg.com/company/announcements/building-a-real-time-news-search-engine/

http://www.flax.co.uk/blog/2016/03/08/helping-bloomberg-build-real-time-news-search-engine/

https://www.youtube.com/watch?v=IOL-6ns7M8k

https://www.youtube.com/watch?v=oMOV7DB4gnA

https://www.youtube.com/watch?v=M7BKwJoh96s

https://www.youtube.com/watch?v=bbbtVQCezaU

Bloomberg is an equal opportunities employer, and we value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Vacancy expired!

Subscribe Report job