Data Engineer, Senior
Posted on Sep 14, 2024 by Bigbear.ai
Arlington, VA
Engineering
Immediate Start
Annual Salary
Full-Time
Overview:
BigBear.ai is seeking an experienced Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our Advana data infrastructure and systems. Your expertise in ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks will be essential in ensuring efficient data processing and analysis.
This role will be Hybrid/Remote reporting to the Crystal, City VA 2- 3 days per week and requires an active Secret clearance.
What you will do:
Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing.
Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets.
Leverage big data technologies to efficiently process and analyze large datasets, particularly those encountered in a federal agency.
Troubleshoot data-related problems and provide innovative solutions to address complex data challenges.
Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices.
Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures.
Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes.
Maintain documentation for software applications, workflows, and processes.
Stay updated with emerging trends and advancements in data engineering and recommend suitable tools and technologies for continuous improvement.
What you need to have:
Secret clearance is required; TS/SCI clearance is preferred.
Minimum of 5 years of experience as a Data Engineer, with demonstrated experience creating data pipelines from scratch.
High level of proficiency in ETL processes and demonstrated, hands-on experience with technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
Strong problem-solving skills and ability to solve complex data-related issues.
Demonstrated experience working with large datasets and leveraging big data technologies to process and analyze data efficiently.
Understanding of data modeling/visualization, database design principles, and data governance practices.
Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
Detail-oriented mindset with a commitment to delivering high-quality results.
DoD or IC-related experience
Must be in the DC Metro area and available to work onsite (Crystal City, VA ) 2-3 days per week.
What we'd like you to have:
Knowledge of Qlik/Qlik Sense, QVD/QlikView, and Qlik Production Application Standards (QPAS) is a significant plus.
Previous experience with Advana is a plus.
About BigBear.ai:
BigBear.ai is a leading provider of AI-powered decision intelligence solutions for national security, supply chain management, and digital identity. Customers and partners rely on BigBear.ai’s predictive analytics capabilities in highly complex, distributed, mission-based operating environments. Headquartered in Columbia, Maryland, BigBear.ai is a public company traded on the NYSE under the symbol BBAI. For more information, visit (url removed) and follow BigBear.ai on LinkedIn: @BigBear.ai and X: @BigBearai.
BigBear.ai is seeking an experienced Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our Advana data infrastructure and systems. Your expertise in ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks will be essential in ensuring efficient data processing and analysis.
This role will be Hybrid/Remote reporting to the Crystal, City VA 2- 3 days per week and requires an active Secret clearance.
What you will do:
Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing.
Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets.
Leverage big data technologies to efficiently process and analyze large datasets, particularly those encountered in a federal agency.
Troubleshoot data-related problems and provide innovative solutions to address complex data challenges.
Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices.
Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures.
Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes.
Maintain documentation for software applications, workflows, and processes.
Stay updated with emerging trends and advancements in data engineering and recommend suitable tools and technologies for continuous improvement.
What you need to have:
Secret clearance is required; TS/SCI clearance is preferred.
Minimum of 5 years of experience as a Data Engineer, with demonstrated experience creating data pipelines from scratch.
High level of proficiency in ETL processes and demonstrated, hands-on experience with technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
Strong problem-solving skills and ability to solve complex data-related issues.
Demonstrated experience working with large datasets and leveraging big data technologies to process and analyze data efficiently.
Understanding of data modeling/visualization, database design principles, and data governance practices.
Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
Detail-oriented mindset with a commitment to delivering high-quality results.
DoD or IC-related experience
Must be in the DC Metro area and available to work onsite (Crystal City, VA ) 2-3 days per week.
What we'd like you to have:
Knowledge of Qlik/Qlik Sense, QVD/QlikView, and Qlik Production Application Standards (QPAS) is a significant plus.
Previous experience with Advana is a plus.
About BigBear.ai:
BigBear.ai is a leading provider of AI-powered decision intelligence solutions for national security, supply chain management, and digital identity. Customers and partners rely on BigBear.ai’s predictive analytics capabilities in highly complex, distributed, mission-based operating environments. Headquartered in Columbia, Maryland, BigBear.ai is a public company traded on the NYSE under the symbol BBAI. For more information, visit (url removed) and follow BigBear.ai on LinkedIn: @BigBear.ai and X: @BigBearai.
Reference: 199205588
https://jobs.careeraddict.com/post/95182486
Data Engineer, Senior
Posted on Sep 14, 2024 by Bigbear.ai
Arlington, VA
Engineering
Immediate Start
Annual Salary
Full-Time
Overview:
BigBear.ai is seeking an experienced Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our Advana data infrastructure and systems. Your expertise in ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks will be essential in ensuring efficient data processing and analysis.
This role will be Hybrid/Remote reporting to the Crystal, City VA 2- 3 days per week and requires an active Secret clearance.
What you will do:
Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing.
Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets.
Leverage big data technologies to efficiently process and analyze large datasets, particularly those encountered in a federal agency.
Troubleshoot data-related problems and provide innovative solutions to address complex data challenges.
Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices.
Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures.
Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes.
Maintain documentation for software applications, workflows, and processes.
Stay updated with emerging trends and advancements in data engineering and recommend suitable tools and technologies for continuous improvement.
What you need to have:
Secret clearance is required; TS/SCI clearance is preferred.
Minimum of 5 years of experience as a Data Engineer, with demonstrated experience creating data pipelines from scratch.
High level of proficiency in ETL processes and demonstrated, hands-on experience with technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
Strong problem-solving skills and ability to solve complex data-related issues.
Demonstrated experience working with large datasets and leveraging big data technologies to process and analyze data efficiently.
Understanding of data modeling/visualization, database design principles, and data governance practices.
Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
Detail-oriented mindset with a commitment to delivering high-quality results.
DoD or IC-related experience
Must be in the DC Metro area and available to work onsite (Crystal City, VA ) 2-3 days per week.
What we'd like you to have:
Knowledge of Qlik/Qlik Sense, QVD/QlikView, and Qlik Production Application Standards (QPAS) is a significant plus.
Previous experience with Advana is a plus.
About BigBear.ai:
BigBear.ai is a leading provider of AI-powered decision intelligence solutions for national security, supply chain management, and digital identity. Customers and partners rely on BigBear.ai’s predictive analytics capabilities in highly complex, distributed, mission-based operating environments. Headquartered in Columbia, Maryland, BigBear.ai is a public company traded on the NYSE under the symbol BBAI. For more information, visit (url removed) and follow BigBear.ai on LinkedIn: @BigBear.ai and X: @BigBearai.
BigBear.ai is seeking an experienced Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our Advana data infrastructure and systems. Your expertise in ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks will be essential in ensuring efficient data processing and analysis.
This role will be Hybrid/Remote reporting to the Crystal, City VA 2- 3 days per week and requires an active Secret clearance.
What you will do:
Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing.
Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets.
Leverage big data technologies to efficiently process and analyze large datasets, particularly those encountered in a federal agency.
Troubleshoot data-related problems and provide innovative solutions to address complex data challenges.
Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices.
Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures.
Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes.
Maintain documentation for software applications, workflows, and processes.
Stay updated with emerging trends and advancements in data engineering and recommend suitable tools and technologies for continuous improvement.
What you need to have:
Secret clearance is required; TS/SCI clearance is preferred.
Minimum of 5 years of experience as a Data Engineer, with demonstrated experience creating data pipelines from scratch.
High level of proficiency in ETL processes and demonstrated, hands-on experience with technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
Strong problem-solving skills and ability to solve complex data-related issues.
Demonstrated experience working with large datasets and leveraging big data technologies to process and analyze data efficiently.
Understanding of data modeling/visualization, database design principles, and data governance practices.
Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
Detail-oriented mindset with a commitment to delivering high-quality results.
DoD or IC-related experience
Must be in the DC Metro area and available to work onsite (Crystal City, VA ) 2-3 days per week.
What we'd like you to have:
Knowledge of Qlik/Qlik Sense, QVD/QlikView, and Qlik Production Application Standards (QPAS) is a significant plus.
Previous experience with Advana is a plus.
About BigBear.ai:
BigBear.ai is a leading provider of AI-powered decision intelligence solutions for national security, supply chain management, and digital identity. Customers and partners rely on BigBear.ai’s predictive analytics capabilities in highly complex, distributed, mission-based operating environments. Headquartered in Columbia, Maryland, BigBear.ai is a public company traded on the NYSE under the symbol BBAI. For more information, visit (url removed) and follow BigBear.ai on LinkedIn: @BigBear.ai and X: @BigBearai.
Reference: 199205588
Share this job:
Alert me to jobs like this:
Amplify your job search:
Expert career advice
Increase interview chances with our downloads and specialist services.
Visit Blog