jobspastpapers.com
robots.txt

Robots Exclusion Standard data for jobspastpapers.com

Resource Scan

Scan Details

Site Domain jobspastpapers.com
Base Domain jobspastpapers.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-02-08T19:01:48+00:00
Next Scan 2025-05-09T19:01:48+00:00

Last Successful Scan

Scanned2023-10-18T18:53:42+00:00
URL https://jobspastpapers.com/robots.txt
Domain IPs 104.21.0.156, 172.67.151.65, 2606:4700:3032::ac43:9741, 2606:4700:3035::6815:9c
Response IP 104.21.0.156
Found Yes
Hash 4e27c7929ccff2b085bd79e1742fb74d2fa880ac24938b99987da5660073a047
SimHash 6b890a4480b1

Groups

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-content/plugins/
Disallow /wp-admin/

Other Records

Field Value
sitemap https://jobspastpapers.com/sitemap_index.xml

Warnings

  • `craw-delay` is not a known field.