pickiverse.com
robots.txt

Robots Exclusion Standard data for pickiverse.com

Resource Scan

Scan Details

Site Domain pickiverse.com
Base Domain pickiverse.com
Scan Status Ok
Last Scan2025-10-17T23:01:14+00:00
Next Scan 2025-10-24T23:01:14+00:00

Last Scan

Scanned2025-10-17T23:01:14+00:00
URL https://pickiverse.com/robots.txt
Redirect https://www.pickiverse.com/robots.txt
Redirect Domain www.pickiverse.com
Redirect Base pickiverse.com
Domain IPs 104.21.63.130, 172.67.145.171, 2606:4700:3035::6815:3f82, 2606:4700:3037::ac43:91ab
Redirect IPs 104.21.63.130, 172.67.145.171, 2606:4700:3035::6815:3f82, 2606:4700:3037::ac43:91ab
Response IP 172.67.145.171
Found Yes
Hash 6452d8a128a21df800d8a50d5a78c58349978848de5b6570cd3f1901724840df
SimHash 45118e326632

Groups

*

Rule Path
Allow /
Disallow /private/
Disallow /admin/
Disallow /api/
Disallow /*?*
Disallow /*/thankyou
Disallow /error

Other Records

Field Value
crawl-delay 2

googlebot

Rule Path
Allow /
Disallow /private/
Disallow /admin/
Disallow /api/
Disallow /login
Disallow /register

bingbot

Rule Path
Allow /
Disallow /private/
Disallow /admin/
Disallow /api/
Disallow /login
Disallow /register

googlebot-mobile

Rule Path
Allow /
Disallow /private/
Disallow /admin/
Disallow /api/
Disallow /login
Disallow /register

Other Records

Field Value
sitemap https://pickiverse.com/sitemap.xml

Warnings

  • `host` is not a known field.