pangoly.com
robots.txt

Robots Exclusion Standard data for pangoly.com

Resource Scan

Scan Details

Site Domain pangoly.com
Base Domain pangoly.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-22T09:23:41+00:00
Next Scan 2026-03-22T09:23:41+00:00

Last Successful Scan

Scanned2024-03-03T07:11:43+00:00
URL https://pangoly.com/robots.txt
Domain IPs 104.26.0.81, 104.26.1.81, 172.67.74.24, 2606:4700:20::681a:151, 2606:4700:20::681a:51, 2606:4700:20::ac43:4a18
Response IP 104.26.1.81
Found Yes
Hash 50e99ce38f6d5ba6140b22eafbcf9c6ed175b94651ba8479a8dde9ee22247a00
SimHash 2d749840e513

Groups

*

Rule Path
Disallow /cdn-cgi/
Disallow /Bin/
Disallow /Views/
Disallow /*/aff/

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

swiftbot

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://pangoly.com/sitemap

Comments

  • MAIN RULEs
  • SITEMAPs