Clearance: Active DHS Public Trust or similar clearance that will gain reciprocity
What You'll Be Doing
The Senior Data Engineer will work with our data warehousing team to transform transactional data into datasets that are consumable by a variety of consumers, for reporting and analytics. The successful candidate will be flexible and forward-leaning, able to learn new tools and skills, and able to learn new data domains as the data warehouse grows.
Required Skills and Experience:
- Bachelor’s degree plus at least 7 years in a data engineering role including ETL development, database development, data integration, data mining, big data
- Strong experience developing and maintaining complex SQL for ETL and reporting
- Strong experience with large complex data systems
- Experience performing database administration tasks (manage scheduled jobs, cluster configurations)
- Experience performing software administration tasks (deploy applications, manage scheduled tasks)
- Ability to learn new tools quickly as needed to provide new ideas for solving problems
- Ability and desire to work with other program staff and customers to reach design decisions within given constraints
- Excellent diplomacy and communication skills with both clients and technical staff
Preferred Skills and Experience:
- Proficiency in Python and Scala
- Experience using Spark and Hive
- Experience with Qlik or other data visualization administration
- Experience completing Databricks development and/or administrative tasks
- Familiarity with some of these tools: DB2, Oracle, SAP, Postgres, Elastic Search, Glacier, Cassandra, DynamoDB, Hadoop, Splunk, SAP HANA, Databricks
- Experience working with federal government clients