Senior Big Data Engineer
Attentive
Data Science
United States
Posted on Saturday, March 2, 2024
Attentive® is the AI-powered SMS and email marketing platform that delivers unparalleled messaging performance on the channels that matter most. Infusing intelligence at every stage of the consumer's purchasing journey, Attentive empowers businesses to achieve hyper-personalized communication with their customers on a large scale. Leveraging AI-powered tools, a mobile-first approach, two-way conversations, and enterprise-grade technology, Attentive drives billions in online revenue for brands around the globe. Trusted by over 8,000 leading brands such as CB2, Urban Outfitters, GUESS, Dickey’s Barbeque Pit, and Wyndham Resort, Attentive is the go-to solution for delivering powerful commerce experiences for consumers with the brands they love.
Attentive’s growth has been recognized by Deloitte’s Fast 500, Linkedin’s Top Startups and Forbes Cloud 100 all thanks to the hard work from our global employees!
Who we are
Our engineering department consists of 200+ people across multiple teams, such as application development, infrastructure, data platform, machine learning, and security. We believe our company will win in the long run through product innovation. To get there, we obsess over iteratively delivering customer value through rapid prototyping and data-driven decision-making.
We’re looking for a self-motivated, highly driven Big Data Engineer to bolster our Data Platform teams. Our team is focused on building the data platform to support data driven products and strategic outcomes for our customers. We do this by providing an extensible and flexible compute platform to access highly available, mission critical data sets.
Why Attentive needs you
- Participate in design, development, and implementation of robust, high volume data-oriented solutions with big data technologies (Python, Spark, Hadoop, etc.).
- Design and implement systems to cleanse, process, and analyze large data sets using distributed processing tools like Flink and Spark.
- Collaborate with cross-functional teams to understand data requirements and provide effective solutions.
- Design and build a self-service data platform that powers Attentive’s AI, ML, and analytics needs, enabling them to experiment quickly and build new data products
About you
- Proven experience as a Big Data Engineer with a focus on large-scale data processing.
- In-depth knowledge of big data technologies such as Hadoop, Spark, Flink and/or Kafka.
- Proficiency in programming languages such as Java, Scala, or Python.
- Experience with ETL and Data pipeline orchestration tools like Apache Airflow, DBT, etc.
- Strong understanding of object-oriented design, data structures, algorithms, profiling, and optimization.
- You have development experience with data tools such as Snowflake, Google BigQuery, Databricks Lakehouse, AWS Athena, Apache Trino, or Presto.
- You’ve experience with open source data storage formats such as Apache Iceberg, Parquet, Arrow, or Hudi.
- You are knowledgeable about data modeling, data access, and data replication techniques, such as CDC.
- You have a proven track record of architecting applications at scale and maintaining infrastructure as code via Terraform.
- You are excited by new technologies but are conscious of choosing them for the right reasons.
Our scale
- 8,000 brands powered by Attentive sent over 2.2 billion text messages over Cyber Week 2023 (Black Friday/Cyber Monday) representing a growth of 31% from 2022.
- We sent 32 billion SMS messages in 2023, up 32% YoY. That’s an average of 87 million per day.
- Our production cluster contains over 18,000 containers which serve 200+ services.
- Our streaming services process over 80 billion events per month.
What we use
- We use a wide variety of technology and we’re always looking for the best solutions to solve hard problems.
- Our backend is Java / Spring Boot microservices, built with Gradle, coupled with things like DynamoDB, Pulsar, AirFlow, Postgres, Planetscale, and Redis, hosted via AWS.
- Our frontend is built with React and TypeScript, and uses best practices like GraphQL, Storybook, Radix UI, Vite, esbuild, and Playwright.
You'll get competitive perks and benefits, from health & wellness to equity, to help you bring your best self to work.
For US based applicants:
- The standard base salary range for this position is $150,000 - $220,000 annually + equity + benefits
- Our salary ranges are determined by role, level, and location.
#LI-FZ1
Attentive Company Values
Default to Action - Move swiftly and with purpose
Be One Unstoppable Team - Rally as each other’s champions
Champion the Customer - Our success is defined by our customers' success
Act Like an Owner - Take responsibility for Attentive’s success
Learn more about AWAKE, Attentive’s collective of employee resource groups.
If you do not meet all the requirements listed here, we still encourage you to apply! No job description is perfect, and we may also have another opportunity that closely matches your skills and experience.
At Attentive, we know that our Company's strength lies in the diversity of our employees. Attentive is an Equal Opportunity Employer and we welcome applicants from all backgrounds. Our policy is to provide equal employment opportunities for all employees, applicants and covered individuals regardless of protected characteristics. We prioritize and maintain a fair, inclusive and equitable workplace free from discrimination, harassment, and retaliation.
