We are looking for a Big Data Engineer that will work on the storing, processing, and analyzing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company.
Selecting and integrating big data frameworks required to provide requested capabilities
Build analysis pipelines as well as visualization dashboards
Monitoring performance and iterate the solution fast
Skills and Qualifications
Proficiency with programming languages such as Python and Java
Proficient understanding of distributed computing principles
Proficiency with Hadoop v2, MapReduce, HDFS
Proficiency with Spark
Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
Knowledge of various ETL techniques and frameworks, such as Flume
Experience with various messaging systems, such as Kafka
About Shape Security
The world’s leading financial, retail and travel companies and government agencies rely on Shape Security as their primary line of defense against fraud and attacks on their web and mobile applications. The Shape platform, covered by 45 patents, was designed to stop the most dangerous application attacks enabled by cybercriminal fraud tools, including credential stuffing (account takeover), product scraping, unauthorized aggregation, and other threats. Shape has prevented over $1 billion in fraud losses for its customers and protects more than 1.3 billion user accounts. Shape is headed by industry leaders from Google, Cisco, IBM, Raytheon, Palo Alto Networks, and the Pentagon.