DIMMiN

Created at: Sept. 24, 2025, noon Updated at: Sept. 24, 2025, 7:02 a.m.

2025-09-24-Wednesday

Adjusted offline pipeline to handle files by directory rather than CSS selector
Created a database schema based on existing data that can be used as input to my algorithm
Found a weird bug where the file feature does not seem to consist of only file:/// paths (this may have to do more with Python Pandas or LibreOffice than my JSON structure though)
Created a prompt that I can send to an LLM that can take the coffee description as input and produce an output of the schema (this could change the emphasis / direction of CupUp - An Analysis of Optimal Coffee, having a section oriented towards LLMs for data cleaning).

Created at: Sept. 23, 2025, noon Updated at: Sept. 23, 2025, 5:39 a.m.

Rebuilt my coe Scrapy Spider so that original response URLs are saved as comments
Re-ran the coe spider to establish a local directory structure that mimics that of the site (for better offline processing)
Built a component of the offline pipeline to extract data from each of the competition pages so I can cross-reference data at the individual / lot level

Created at: Sept. 22, 2025, noon Updated at: Sept. 22, 2025, 8:52 a.m.

Extracted links from Scrapy Spider log files to prevent duplicate queries
Collected data on 5,612 different lots of coffee from the Cup of Excellence website
Built a pipeline for both the /farm-directory/ and /listing/ to store semi-structured JSON formatted data
Created first semi-structured dataset of COE data

Created at: Sept. 21, 2025, noon Updated at: Sept. 21, 2025, 4:55 a.m.

Fixed Blog Post's Post Django model so that it doesn't send email notifications when in the dev environment and Post.publish_date is updated when is_active is toggled from False to True (Resolving issue 120 and issue 133).
Started working on the next Blog Post, CupUp - An Analysis of Optimal Coffee
Built a quick web scraper using Scrapy to gather all of the data I could from the Cup of Excellence competition, collecting ~97% of all coffee lots and their associated competition data

Created at: Sept. 21, 2025, noon Updated at: Sept. 20, 2025, 4:23 a.m.

Created at: Sept. 19, 2025, noon Updated at: Sept. 20, 2025, 3:09 a.m.

Created at: Sept. 18, 2025, noon Updated at: Sept. 18, 2025, 11:59 p.m.

Created at: Sept. 17, 2025, noon Updated at: Sept. 17, 2025, 4:35 a.m.

Continued to work on Homelab is Where the Heart Is (remote access to the homelab via VPN, homelab use cases, etc)
Finished the majority of the first draft of Homelab is Where the Heart Is (just need to finish the section on portainer for homelab use cases)

Created at: Sept. 15, 2025, noon Updated at: Sept. 15, 2025, 4:59 a.m.

Created at: Sept. 15, 2025, noon Updated at: Sept. 14, 2025, 10:21 p.m.