scrapling

We have hosted the application scrapling in order to run this application in our online workstations with Wine or directly.

Quick description about scrapling:

Scrapling is an adaptive web scraping framework designed to handle everything from a single HTTP request to large-scale, concurrent crawls. Built for modern websites, it intelligently adapts to structural changes by automatically relocating elements when page layouts update. The framework includes advanced fetchers capable of bypassing anti-bot protections such as Cloudflare Turnstile using stealth and browser automation techniques. Its powerful spider system supports multi-session crawling, pause and resume functionality, and real-time streaming of scraped data. Scrapling combines high performance, memory efficiency, and extensive async support to deliver blazing-fast scraping workflows. With a developer-friendly API, CLI tools, MCP server integration for AI-assisted extraction, and Docker support, it offers a complete solution for modern web scrapers.

Features:

• Adaptive element tracking that automatically relocates elements when website structures change.
• Advanced fetchers with HTTP, dynamic browser automation, and stealth modes to bypass anti-bot systems.
• Full spider framework with concurrent crawling, multi-session routing, and checkpoint-based pause/resume.
• Built-in proxy rotation and session management with support for persistent cookies and state handling.
• Interactive CLI and web scraping shell for extracting content without writing code.
• High-performance parser with fast JSON serialization, async support, and AI-ready MCP server integration.

Programming Language: Python.
Categories: