petersendean.com
robots.txt

Robots Exclusion Standard data for petersendean.com

Resource Scan

Scan Details

Site Domain petersendean.com
Base Domain petersendean.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-14T07:20:04+00:00
Next Scan 2024-12-13T07:20:04+00:00

Last Successful Scan

Scanned2021-12-14T13:13:55+00:00
URL https://petersendean.com/robots.txt
Response IP 96.125.164.78
Found Yes
Hash bc326d418d2ea779d2367393833716eaab70d5d8bb92770bf9439cfe166abf97
SimHash c000cb60ca61

Groups

*

Rule Path
Disallow /404.html?page=%2F
Disallow /adword/
Disallow /audit/
Disallow /audit/
Disallow /austin/
Disallow /booking/
Disallow /builder/
Disallow /builders/
Disallow /deals/
Disallow /dev-updates/
Disallow /dev/
Disallow /kiosk/
Disallow /media/
Disallow /obs/
Disallow /pdfs/
Disallow /portal/
Disallow /powersaver/
Disallow /salesforce/
Disallow /sap/
Disallow /scf/
Disallow /site-survey/
Disallow /siteaudit/
Disallow /solar1/
Disallow /sugarvsstarburst/
Disallow /supply/
Disallow /training/
Disallow /users/
Disallow /wp-snapshots/
Disallow /validate/
Disallow /v1/
Disallow /old/
Disallow /video/
Disallow /tel%3A18888935222
Disallow /tel%3A18886597513

ninjabot

Rule Path
Allow /

Comments

  • robotstxt.org/
  • Disallow: /adwords/