thelist-app.com
robots.txt

Robots Exclusion Standard data for thelist-app.com

Resource Scan

Scan Details

Site Domain thelist-app.com
Base Domain thelist-app.com
Scan Status Ok
Last Scan2025-09-11T17:01:41+00:00
Next Scan 2025-09-25T17:01:41+00:00

Last Scan

Scanned2025-09-11T17:01:41+00:00
URL https://thelist-app.com/robots.txt
Domain IPs 104.26.0.40, 104.26.1.40, 172.67.68.208, 2606:4700:20::681a:128, 2606:4700:20::681a:28, 2606:4700:20::ac43:44d0
Response IP 104.26.0.40
Found Yes
Hash 793ce42c0cbdfa32125eb8b8ee27c364ba97e05cbd3100ea563cede932c9b5a8
SimHash 6b04d86123f6

Groups

googlebot
google
bingbot
bing

Rule Path
Allow /wp-content/uploads/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.thelist-app.com/sitemap.xml