Posts – Trickster Dev

Katana: web crawler for offensive security and web exploration 2024-10-01

Lesser known parts of Python standard library 2024-08-19

Simple ways to find exposed sensitive information 2024-06-21

Understanding SOCKS protocol 2024-05-04

Scraping Clutch for B2B company data 2024-04-12

SSH tips and tricks 2024-02-04

Retrospective scraping of historical data from Internet Archive snapshots 2023-12-27

Obscure corners of a standard macOS installation 2023-11-11

Scraping data from Google Places API 2023-11-05

Extracting data from elasticsearch API 2023-10-16

Setting up mitmproxy with iOS 17.1 2023-10-04

Parsing HTML documents with Beautiful Soup 2023-09-22

Solving a simple JS challenge with sandboxing 2023-09-15

Abusing GOAT mobile API for data scraping 2023-08-14

Scrapy by example: scraping company data from Yelp 2023-08-12

Back to the terminal: the new era of CLI and TUI software 2023-08-09

Restringer: modular JavaScript deobfuscator 2023-07-30

Using Scrapy-playwright for integrating browser automation with Scrapy 2023-07-22

Self-defending JS code and debugger traps 2023-07-02

Abusing Ahrefs Backlink Checker 2023-06-27

Don’t JSFuck with me: Part 3 2023-06-25

Prompting the LLM is no substitute for knowledge work 2023-05-31

Understanding JavaScript packers 2023-05-30

Scraping product data from Nike.com 2023-05-15

How do they (try to) block bots: a broad review of automation countermeasures 2023-05-14

CrawlSpider and link extractors for rule-based crawling in Scrapy 2023-05-02

Intro to Bash scripting for scraping and automation 2023-04-04

Don’t JSFuck with me: Part 2 2023-03-14

Don’t JSFuck with me: Part 1 2023-02-24

Understanding HTTP/2 fingerprinting 2023-02-23

JavaScript AST manipulation with Babel: reducing nestedness, unflattening the CFG 2023-02-18

JavaScript AST manipulation with Babel: reducing indirection, undoing string concealing 2023-02-13

JavaScript AST manipulation with Babel: constant folding and propagation 2023-02-07

JavaScript AST manipulation with Babel: AST modification APIs 2023-01-30

JavaScript AST manipulation with Babel: untangling scope confusion 2023-01-25

JavaScript AST manipulation with Babel: 3 ways to create nodes and subtrees 2023-01-23

JavaScript AST manipulation with Babel: transform prototyping and plugin development 2023-01-18

Understanding Python generators for scraping and automation 2023-01-15

Scraping Yahoo! Finance with Python 2023-01-14

Vim is touch-typing on steroids 2023-01-12

Scrapy simplified: developing a single file web scraper 2022-12-26

Getting the data under version control with dolt 2022-12-15

Understanding SPF, DKIM, DMARC for email security and deliverability 2022-12-14

SMTP, IMAP, POP3 and MIME: understanding email protocols 2022-11-21

Wget tips and tricks 2022-11-11

Axiom: just-in-time dynamic infra for offensive security operations 2022-11-07

Scraping legacy ASP.Net sites with Scrapy: a real world example 2022-10-12

Making heuristics smarter with GPT-3 2022-10-09

JavaScript AST manipulation with Babel: defeating string array mapping 2022-10-08

Active DNS recon techniques 2022-09-24

Passive DNS recon techniques 2022-09-17

HTTPX: modern Python module for doing HTTP(S) requests 2022-09-16

Recon-ng: modular framework for OSINT automation 2022-09-07

cURL beyond the basics 2022-09-04

Running Stable Diffusion on Vultr 2022-08-31

Experimenting with DALL-E 2022-08-30

JavaScript AST manipulation with Babel: removing unreachable code 2022-08-28

Building Python script CLIs with argparse and Click 2022-08-27

ImageMagick: programmable image processing toolkit 2022-08-14

Writing custom Scrapy middleware for proxy pool integration 2022-08-14

Decompiling Android apps 2022-08-02

JavaScript AST manipulation with Babel: extracting hardcoded data 2022-08-02

More tools of the trade for scraping and automation 2022-07-26

JavaScript AST manipulation with Babel: the first steps 2022-07-20

Javascript obfuscation techniques by example 2022-07-10

How to scrape Zillow with Python and Scrapy 2022-07-02

Understanding TLS fingerprinting 2022-06-27

How to scrape Youtube view intensity time series 2022-06-16

Understanding Abstract Syntax Trees 2022-06-15

Notes from The Bug Hunters Methodology - Application Analysis v1 2022-06-14

Building higher-order automation workflows with n8n 2022-06-12

Importing Shopify product info programmatically 2022-06-04

Turning Scrapy spider into API with ScrapyRT 2022-06-04

Scraping Instagram API with Instauto 2022-05-23

Scapy: low level packet hacking toolkit for Python 2022-05-08

Strategies and patterns of gray hat social media automation 2022-04-26

You probably don’t need AWS and are better off without it 2022-04-20

Compiling Python programs with Pyinstaller 2022-04-19

Notes on TBHM v4 recon edition 2022-04-14

Writing web scrapers in Go with Colly framework 2022-04-09

Creating DC proxies on cloud providers 2022-04-03

SMTP user enumeration for fun and profit 2022-04-02

Running GUI apps within Docker containers 2022-03-26

Reproducible Linux environments with Vagrant and Terraform 2022-03-25

Decrypting your own HTTPS traffic with Wireshark 2022-03-20

Scrapy framework architecture 2022-03-20

How to scrape pages behind login with Python 2022-03-13

Using Scrapy pipelines to export scraped data 2022-03-13

How to use Scrapy Cloud 2022-03-10

Sending notifications programmatically: let me count the ways 2022-03-09

Evaluating MS Playwright for gray hat automation 2022-03-05

Automating spreadsheet tasks with openpyxl 2022-02-24

Scrapy framework tips and tricks 2022-02-20

Email harvesting from Github profiles 2022-02-19

CAPTCHA solver services for scraping and automation 2022-02-13

Introduction to Scrapy framework 2022-02-13

Tools of the trade for scraping and automation 2022-02-06

Harvesting emails from Google search results 2022-02-04

The very basics of XPath for web scraping: less than 1% of XPath language to scrape more than 90% of pages 2022-01-31

Using proxies for web scraping and automation 2022-01-31

Setting up mitmproxy with Android 2022-01-23

Setting up mitmproxy with iOS 15 2022-01-23

Using Python and mitmproxy to scrape private API of mobile app 2022-01-19

You don’t typically need Selenium for scraping and automation 2022-01-18

Easier JSON wrangling with jq, JSONPath and JSONPointer 2022-01-09

Python Web Scraping: tips and tricks 2022-01-04

Grayhat Twitch Chatbots 2021-12-27

Automating Google Dorking 2021-12-19

Using ephemeral Onion Services for quick NAT traversal 2021-12-12

Sending mass DMs on Reddit through API: a small experiment 2021-12-04

Introducing GPT-3: Playground and API 2021-11-26

How does PerimeterX Bot Defender work 2021-11-20

How to download embedded videos 2021-11-11