adspickup.com
robots.txt

Robots Exclusion Standard data for adspickup.com

Resource Scan

Scan Details

Site Domain adspickup.com
Base Domain adspickup.com
Scan Status Ok
Last Scan2025-09-23T11:48:29+00:00
Next Scan 2025-10-23T11:48:29+00:00

Last Scan

Scanned2025-09-23T11:48:29+00:00
URL https://adspickup.com/robots.txt
Domain IPs 199.188.201.137
Response IP 199.188.201.137
Found Yes
Hash a68046001849a2462bd79b5d8ee5d1a1e11c9f7aed9a4aa5c040324c3daff688
SimHash b7286a77c937

Groups

facebookexternalhit/1.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

bingbot/2.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 25

googlebot/2.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

dotbot/1.2

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20