Data Pipelines: OpenWeatherMap-Airflow [A How-To Guide] (hackernoon.com) #hackernoon  #how-to  #data  >>> #api  #etl  #data-pipeline  #airflow  #data-pipe  #data-pipelines  #how-to-develop-etl-pipeline  #setup-database-etl-pipeline  #setup-airflow-etl-pipeline  #amaoche-airflow-etl-pipeline 
1 points by TaglyBot 2 hours ago | discuss | Post to hn | Add to Todo
Python ETL Tools: Best 8 Options (towardsdatascience.com) #data-science  #python  #big-data  >>> #data-warehouse  #etl 
1 points by TaglyBot yesterday | discuss | Post to hn | Add to Todo
ELT Data Pipelining in Snowflake Data Warehouse — using Streams and Tasks (towardsdatascience.com) #data-science  #database  #etl  >>> #snowflake  #elt  #snowflakedb 
1 points by TaglyBot yesterday | discuss | Post to hn | Add to Todo
Data Warehouse ETL with Matthew Scullion (softwareengineeringdaily.com) #data  #podcast  #all-content  >>> #exclusive-content  #data-engineering  #warehouse  #data-warehouse  #etl  #data-transformation  #matillion  #matthew-scullion 
1 points by TaglyBot 4 days ago | discuss | Post to hn | Add to Todo
Fivetran: Data Connectors with George Fraser (softwareengineeringdaily.com) #data  #podcast  #all-content  >>> #exclusive-content  #etl  #connectors  #data-warehousing  #data-connectors  #fivetran  #george-fraser 
1 points by TaglyBot 5 days ago | discuss | Post to hn | Add to Todo
Automatic Airflow DAG creation for Data Scientists and Analysts (towardsdatascience.com) #data-science  #python  #aws  >>> #data-scientist  #etl  #airflow 
1 points by TaglyBot 27 days ago | discuss | Post to hn | Add to Todo
Data Engineers are not just technology experts (towardsdatascience.com) #data-science  #big-data  #data-engineering  >>> #data-engineer  #etl 
1 points by TaglyBot one month ago | discuss | Post to hn | Add to Todo
New Quick Start deploys Matillion ETL for Amazon Redshift on AWS (aws.amazon.com) #n-a  #n-a  #n-a  >>> #n-a  #amazon  #n-a  #n-a  #best  #about  #aws  #services  #start  #web  #following  #database  #aurora  #single  #high  #quick  #availability  #best-practices  #the-amazon  #amazon-web-services  #cluster  #web-service  #best-practi  #web-services  #amazon-web-service  #best-practice  #amazon-aurora  #etl  #amazon-redshift  #redshift  #high-availability  #quick-start  #aws-best-practices  #matillion 
1 points by TaglyBot one month ago | discuss | Post to hn | Add to Todo
Check-list: selecting the right data transformation service for Google BigQuery (towardsdatascience.com) #data-science  #analytics  #google-cloud-platform  >>> #data-preparation  #bigquery  #etl 
1 points by TaglyBot one month ago | discuss | Post to hn | Add to Todo
KNIME Desktop: the “killer app” for machine learning and statistics (towardsdatascience.com) #data-science  #machine-learning  #data  >>> #etl  #knime 
1 points by TaglyBot 2 months ago | discuss | Post to hn | Add to Todo
Introduction to Papermill (towardsdatascience.com) #data-science  #jupyter-notebook  #etl  >>> #data-pipeline  #paper-mill 
1 points by TaglyBot 2 months ago | discuss | Post to hn | Add to Todo
AWS Glue now enables you to bring your own JDBC drivers to your Glue Spark ETL jobs (aws.amazon.com) #target  #n-a  #n-a  >>> #it  #n-a  #n-a  #n-a  #data  #aws  #jobs  #service  #v  #job  #learn  #source  #feature  #bring  #same  #custom  #native  #sources  #spark  #visit  #oracle  #connect  #prepare  #driver  #drivers  #different  #databases  #mysql  #load  #glue  #migrate  #etl  #connectors  #aws-glue 
1 points by TaglyBot 2 months ago | discuss | Post to hn | Add to Todo
AWS Glue now supports the FindMatches ML Transform on Apache Spark 2.4.3 and AWS Glue version 1.0 (aws.amazon.com) #n-a  #n-a  #n-a  >>> #n-a  #n-a  #aws  #running  #ml  #version  #spark  #apache  #transform  #apache-spark  #form-i  #glue  #etl  #scripts  #aws-glue 
1 points by TaglyBot 2 months ago | discuss | Post to hn | Add to Todo
AWS Glue now provides the ability to rewind job bookmarks for your Spark ETL jobs (aws.amazon.com) #from  #data  #aws  >>> #jobs  #state  #job  #run  #any  #information  #spark  #ability  #tracks  #glue  #etl  #aws-glue  #bookmarks  #rewind 
1 points by TaglyBot 3 months ago | discuss | Post to hn | Add to Todo
AWS Glue now provides ability to use custom certificates for JDBC Connections (aws.amazon.com) #from  #n-a  #data  >>> #c-c  #c-c  #aws  #c-c  #when  #jobs  #custom  #sources  #connect  #ability  #decide  #third-party  #default  #connections  #certificate  #glue  #etl  #aws-glue 
1 points by TaglyBot 4 months ago | discuss | Post to hn | Add to Todo
Parquet conversion in AWS using Airflow (Part 1) (towardsdatascience.com) #data-science  #big-data  #etl  >>> #apache-airflow  #parquet  #parquet-airflow-aws 
1 points by TaglyBot 4 months ago | discuss | Post to hn | Add to Todo
Parquet conversion in AWS using Airflow (Part 2) (towardsdatascience.com) #data-science  #python  #aws  >>> #etl  #apache-airflow  #parquet 
1 points by TaglyBot 4 months ago | discuss | Post to hn | Add to Todo
Fivetran: Data Connectors with George Fraser (softwareengineeringdaily.com) #data  #podcast  #all-content  >>> #exclusive-content  #etl  #connectors  #data-warehousing  #data-connectors  #fivetran  #george-fraser 
1 points by TaglyBot 4 months ago | discuss | Post to hn | Add to Todo
AWS Glue now supports the ability to test your Glue ETL scripts on development endpoints using Apache Spark 2.4.3 and Python 3 (aws.amazon.com) #3  #python  #development  >>> #aws  #take  #support  #features  #available  #test  #test  #infrastructure  #version  #spark  #ability  #apache  #new-feature  #addition  #apache-spark  #new-features  #fixes  #advantage  #glue  #etl  #stability  #scripts  #aws-glue 
1 points by TaglyBot 5 months ago | discuss | Post to hn | Add to Todo
AWS Glue now provides the Apache Spark UI to monitor and troubleshoot Glue ETL jobs (aws.amazon.com) #aws  #jobs  #available  >>> #plans  #web  #job  #running  #event  #i-t  #sql  #ui  #monitor  #spark  #graph  #interface  #apache  #apache-spark  #timeline  #glue  #etl  #query  #stages  #aws-glue  #web-interface  #terminated  #directed-acyclic-graph  #spark-sql  #event-time 
1 points by TaglyBot 5 months ago | discuss | Post to hn | Add to Todo