ins.popmars.com
robots.txt

Robots Exclusion Standard data for ins.popmars.com

Resource Scan

Scan Details

Site Domain ins.popmars.com
Base Domain popmars.com
Scan Status Ok
Last Scan2025-10-27T17:44:33+00:00
Next Scan 2025-11-26T17:44:33+00:00

Last Scan

Scanned2025-10-27T17:44:33+00:00
URL https://ins.popmars.com/robots.txt
Domain IPs 216.150.1.129, 216.150.16.129
Response IP 216.150.16.193
Found Yes
Hash 9d260f1f2ebc7bc1a00594dbe282e37d9a8d82d2cdca5e0f967c4008d3ce8d30
SimHash 6f184c10c794

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /_next/
Disallow /profile/
Disallow /subscription/cancel
Disallow /*?*

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /_next/
Disallow /profile/
Disallow /subscription/cancel

bingbot

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /_next/
Disallow /profile/
Disallow /subscription/cancel

Other Records

Field Value
crawl-delay 2

badbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://ins.popmars.com/sitemap.xml

Warnings

  • `host` is not a known field.