Log In Sign Up

webpop.io
robots.txt

Robots Exclusion Standard data for webpop.io

Resource Scan

Scan Details

Site Domain webpop.io
Base Domain webpop.io
Scan Status Ok
Last Scan2024-10-04T07:34:19+00:00
Next Scan 2024-10-11T07:34:19+00:00

Last Scan

Scanned2024-10-04T07:34:19+00:00
URL https://webpop.io/robots.txt
Domain IPs 104.21.8.87, 172.67.139.14, 2606:4700:3035::6815:857, 2606:4700:3037::ac43:8b0e
Response IP 104.21.8.87
Found Yes
Hash 7fde77a269093be58cb4977ed9e25bc20cf2730d9115c8b696d5e8e53cb25d61
SimHash 5210c8508993

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

perplexitybot
ccbot
anthropic-ai
archive.org_bot
google-extended
chatgpt-user
ia_archiver
gptbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://webpop.io/sitemaps.xml
Back to top