pavancab.com
robots.txt

Robots Exclusion Standard data for pavancab.com

Resource Scan

Scan Details

Site Domain pavancab.com
Base Domain pavancab.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-12-26T09:34:43+00:00
Next Scan 2026-02-24T09:34:43+00:00

Last Successful Scan

Scanned2025-10-27T10:26:14+00:00
URL https://pavancab.com/robots.txt
Domain IPs 2a02:4780:11:1776:0:2ad5:4905:2, 82.112.239.20
Response IP 82.112.239.20
Found Yes
Hash 71054a7fe64e3c2987016d58b516ba6432b59dbcf5087e1463812800c5fcd6a4
SimHash a15ccab2e3bb

Groups

*

Rule Path
Allow /

httrack

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

Comments

  • Block known content scrapers