Overview
Allied Consultants, Inc. is an Austin-based firm which has for 32 years been a premier provider of technical and business professionals to clients in Texas. We are currently seeking an experienced Snowflake Engineer to be a key resource on a technical services team.
Allied Consultants offers its family of consultants excellent rates, a local support staff, and an attractive benefits package which includes medical insurance (Allied shares a percentage of the cost), life insurance, a matching 401(k) plan and a cafeteria plan.
Candidates selected for interview will be required to undergo criminal background checks and may be required to complete a drug screen in accordance with Federal and State Law. Offers of Employment are contingent on a successful background check
Allied Consultants is an equal opportunities employer.
**Location of job: Remote**
Responsibilities
- Design overall data structure, ensuring that Snowflake's features (e.g., data sharing, scalability, secure data exchange, etc.) are fully utilized to meet the business requirements.
- Create a blueprint for how data will be stored, processed, and accessed within the Snowflake platform.
- Perform optimization of data pipelines and workflows for performance, scalability, and cost-efficiency.
- Design ETL (Extract, Transform, Load) or ELT (Extract, Load, Transform) processes, and optimize queries and data storage strategies.
- Integrate with other cloud services (e.g., AWS, Azure, GCP), third-party tools, and on-premises data systems.
- Designs and implements strategies to control access to sensitive data, applying encryption, role-based access control, and data masking as necessary.
- Work closely with data engineers, data scientists, business analysts, and other stakeholders to understand their requirements and ensure the Snowflake environment meets those needs.
- Monitor the performance of the Snowflake environment, identifying bottlenecks, and ensuring optimal query performance.
- Automate administrative tasks using Snowflake SQL and scripting languages like Python or Shell scripting.
- Preform data loading methods (bulk loading using COPY INTO, Snow pipe for real-time ingestion, and External tables).
- Perform Snowflake cloning capabilities for databases and schemas.
- Perform configuration and management of Snowflake Virtual Warehouses including scaling, resizing and auto-suspend/resume settings.
- Implement roles and privileges for managing secure access utilizing Snowflake RBAC (Role-Based Access Control)
- Integrate Snowflake SSO (Single Sign-On) and SCIM (System for Cross-domain Identity Management) for secure access and identity management.
- Configure alerts and monitor data pipeline failures, resource spikes, and cost thresholds.
Qualifications
Minimum Requirements:
- 8 years experience with data modeling, data integration, data warehousing, data governance, and data security
- 8 years experience with Oracle and/or PostgreSQL in HA deployments and Expertise in data storage
- 8 years of proficiency in Snowflake architecture and its components.
- 8 years of hands-on experience with Snowflake objects such as Databases, Procedures, Tasks, and Streams.
- 8 years expertise in using Snowflake's cloning capabilities for databases and schemas.
- 8 years of proven experience in managing Snowflake Warehouses and optimizing performance for efficient query execution.
- 8 years of proficiency in Snowflake RBAC (Role-Based Access Control), including implementation of roles and privileges.
- 8 years experience with integrating Snowflake SSO (Single Sign-On) and SCIM (System for Cross-domain Identity Management) for secure access and identity management.
- 8 years experience working with data integration tools like Informatica and ADF for seamless ETL/ELT processes.
- 8 years ability to automate administrative tasks using Snowflake SQL and scripting languages like Python or Shell scripting.
- 8 years expertise in monitoring and troubleshooting Snowflake environments, including usage tracking and query profiling.
- 8 years of strong understanding of Snowflake's security features such as data masking, encryption, and network policies.
- 8 years of technical writing and diagramming skills, including proficiency with modeling and mapping tools (e.g., Visio, Erwin), and the Microsoft Office Suite (Word, Excel, and PowerPoint) and MS Project.
- 8 years experience on an agile sprint team
- 8 years experience with JIRA software
- 8 years experience working with multiple teams concurrently, being able to prioritize and complete work on time with high quality
- 8 years knowledge of Informatica 10.5
- 8 years of developing reports in Cognos Analytics 11.1
Preferred:
- 5 years of familiarity with CI/CD pipelines and version control for managing Snowflake code deployments.
- 5 years of prior experience in the Healthcare Industry
- 5 years of prior experience with an HHS agency
- 5 years of prior experience working with PII or PHI data
- 5 year prior experience working with HL7 data
- 5 years prior experience with Azure
- 4 years Bachelor's degree in computer science, Information Systems, or Business or equivalent experience.