The latest articles on DEV Community by Norton Augusto Herrero dos Santos (@norton794). https://dev.to/norton794 https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F723742%2F72571a1c-42e2-47e8-84f3-cc060982d4d3.jpg https://dev.to/norton794 en Norton Augusto Herrero dos Santos Sat, 12 Oct 2024 17:26:09 +0000 https://dev.to/norton794/what-is-data-engineering-1o1e https://dev.to/norton794/what-is-data-engineering-1o1e <p>Simply defined, data engineering is the set of processes and techniques for collection, validation, treatment and modeling made so that raw data becomes quality data and accessible to end users, thus enabling future analyses.</p> <p>The engineering process is the gear between the extraction/collection of sources (ERP, Excel, etc.) and the availability of processed and validated data in a separate environment (DW).</p> dataengineering datascience Norton Augusto Herrero dos Santos Sat, 12 Oct 2024 17:21:12 +0000 https://dev.to/norton794/o-que-e-engenharia-de-dados-574k https://dev.to/norton794/o-que-e-engenharia-de-dados-574k <p>Definindo de forma simples, a engenharia de dados é o conjunto de processos e técnicas de coleta, validação, tratamento e modelagem feitos para que dados brutos se tornem dados de qualidade e acessíveis aos usuários finais, assim possibilitando análises futuras.</p> <p>O processo de engenharia é a engrenagem entre a extração/coleta da fonte (ERP, Excel, etc.) e a disponibilização dos dados tratados e validados em um ambiente separado (DW).</p> dataengineering datascience