Politeness Policy: Rate Limits, Delays, and Scheduling
Design a politeness policy: per-domain rate limiting, crawl-delay handling, time windows, and exponential backoff. Include instrumentation to prove compliance.
Author: Assistant
Category: research-bot | Model: GPT-5.2