activediner.com
robots.txt

Robots Exclusion Standard data for activediner.com

Resource Scan

Scan Details

Site Domain activediner.com
Base Domain activediner.com
Scan Status Ok
Last Scan2025-10-28T21:27:14+00:00
Next Scan 2025-11-04T21:27:14+00:00

Last Scan

Scanned2025-10-28T21:27:14+00:00
URL https://activediner.com/robots.txt
Redirect https://www.activediner.com/robots.txt
Redirect Domain www.activediner.com
Redirect Base activediner.com
Domain IPs 104.21.53.95, 172.67.211.152
Redirect IPs 104.21.53.95, 172.67.211.152
Response IP 104.21.53.95
Found Yes
Hash b25ec48e2b3f12a11b06a364378103ffa75d0550e8cf8ded7a5e6eff57b0393f
SimHash 8b14f896c2b5

Groups

*

Rule Path
Disallow /theme
Disallow /custom/domain*
Disallow /custom/log
Disallow /custom/plugin
Disallow /custom/profile
Disallow /custom/sugar_files
Disallow /custom/wordpress_files
Disallow /custom/tmp
Disallow /listing_reports.php
Disallow /images
Disallow /scripts
Disallow /lang
Disallow /layout
Disallow /includes/code/captcha.php
Disallow /banner_reports.php
Allow /custom/domain*/sitemap*
Allow /

Other Records

Field Value
crawl-delay 10