reillyroofing.com
robots.txt

Robots Exclusion Standard data for reillyroofing.com

Resource Scan

Scan Details

Site Domain reillyroofing.com
Base Domain reillyroofing.com
Scan Status Ok
Last Scan2024-09-26T16:31:30+00:00
Next Scan 2024-10-03T16:31:30+00:00

Last Scan

Scanned2024-09-26T16:31:30+00:00
URL https://reillyroofing.com/robots.txt
Domain IPs 104.26.12.30, 104.26.13.30, 172.67.72.250, 2606:4700:20::681a:c1e, 2606:4700:20::681a:d1e, 2606:4700:20::ac43:48fa
Response IP 104.26.13.30
Found Yes
Hash 0251c9051e1bdcccf2a5b18467bf10d1a8750e70c74a83ffd33d409168d7cb93
SimHash 6001d08157b5

Groups

applebot
bingbot
googlebot
googlebot-image
mediapartners-google
msnbot
msnbot-media
slurp
twitterbot
telegrambot
yahoo-blogs
yahoo-mmcrawler
yandex
*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://reillyroofing.com/sitemap.xml

Comments

  • allow only important bots
  • disallow directories