Discover how to efficiently deploy a Django web application using Docker, Gunicorn, and Nginx on DigitalOcean. Follow this comprehensive guide to set up your environment, configure your application, and ensure your web app is scalable and production-ready.
Category Archives: Application Development
How to Set up Django with Docker, PostgreSQL and React
This article provides a comprehensive guide for setting up a Python web project using Django with Docker, PostgreSQL, and React. It outlines an iterative approach, starting from Django project setup and gradually introducing Docker and PostgreSQL integration, before concluding with React implementation. This ensures a streamlined and consistent development process.
Web Scraping, Part 4 – Scrapy
The article discusses using the Scrapy library to scrape data from the American Gem Society website. Scrapy is a modular framework that allows users to build customizable web crawlers, known as “spiders.” The post details spider creation, defining crawling rules, parsing HTML data, and collecting jeweler information efficiently using XPath.
Web Scraping, Part 3: Scraping Case Study
This post outlines a web scraping case study focused on extracting contact details of jewelers certified by the American Gem Society (AGS). It explains ethical considerations and technical approaches for navigating the AGS website, methodically traversing state pages to compile a comprehensive dataset of jeweler information, ultimately aiming to generate structured JSON outputs.
Web Scraping, Part 2: Parsing
In the last post, we saw that many times the web page you request is not the page you receive. Similarly, often the page you’ve downloaded looks nothing like the page you end up viewing. When you download a web page, your browser executes scripts that transform the raw content into something entirely different. Consequently,Continue reading “Web Scraping, Part 2: Parsing”
Web Scraping, Part 1: Web Scraping Basics
The upcoming series will focus on web scraping through progressively complex case studies. Initial discussions will cover how browsers retrieve web content and the importance of HTTP headers. The author will demonstrate using various Python libraries to scrape data, with an emphasis on understanding URL structures and parsing content efficiently.
On Web Scraping
Web scraping is the process of programmatically extracting content from websites and has various applications, such as analyzing medical payments to doctors or gathering job postings. However, it raises ethical and legal questions, particularly regarding terms of use violations. The practice combines programming skills with problem-solving, creating a unique intellectual challenge.
Plumbing and Coding
The author reflects on the complexities of plumbing while attempting to connect a water line from a sink to a fridge. Despite the seemingly simple task, various materials, sizes, and connections complicate the process. Drawing parallels to software development, the author emphasizes the necessity of understanding frameworks and gaining experience to effectively solve problems.