Arguably the biggest part of data warehousing is tying data from multiple sources together to create a single version of the truth. Sometimes, lookup tables or data conversions are needed to join data. In these instances we often rely on cross-platform data consistency.
Apache Airflow is a fantastic platform for scheduling workflows for the ETL of a Data Warehouse. MWAA is the AWS managed implementation of this, allowing for easier management and scalability of workers among other improvements. The problem with MWAA however is that the automatic scaling of workers is currently broken, with a major architectural miss.
The Photo Gallery by WD – Responsive Photo Gallery plugin is great for building small galleries to display on a blog, and providing a basic search tool to filter using the descriptions and titles of images. For larger galleries however, the search tool is limited, such that it only returns exact in-string matches, meaning that …
Improving Search Engine in WordPress WD Photo Gallery Plugin Read More »
The Arduino Starter Kit is the perfect set of components to start learning electronics and coding, coming with a book containing a number of short projects and all the bits necessary to build an array of different circuits and programs, it creates a fantastic foundation. I recently picked one of these Starter Kits up with …
SQL*Plus is commonly used to extract data from an ORACLE database, by simply spooling query results out to a file. Generally by CSV, SQL*Plus extracts can be used for reporting data or viewing meta-data. There are various limitations to extracting to basic CSV however, one particular one being CLOBs; a good way to partially resolve …