en.compathy.net
robots.txt

Robots Exclusion Standard data for en.compathy.net

Resource Scan

Scan Details

Site Domain en.compathy.net
Base Domain compathy.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-07T15:46:18+00:00
Next Scan 2024-10-05T15:46:18+00:00

Last Successful Scan

Scanned2021-08-31T14:40:02+00:00
URL https://en.compathy.net/robots.txt
Found Yes
Hash d991aedc054cf83f4d8543a52576bf19fe49614348e24a77bf15e7bfdabf7791
SimHash 79800f56c69b

Groups

*

Rule Path
Disallow /tripnotes/new
Disallow /tripnotes/*/edit
Disallow /*_escaped_fragment_%3D
Disallow /*fb_source
Disallow /*utm_source
Disallow /*from%3Dfb_m
Disallow /api/*
Disallow /users/keita.yasumoto.39/logbooks
Disallow /users/keita.yasumoto.39/wishlists/
Disallow /users/keita.yasumoto.39/wishlists/*
Disallow /users/keita.yasumoto.39/wishlists/myanmar-burma
Disallow /users/keita.yasumoto.39/wishlists/portugal
Disallow /hong-kong
Disallow /indonesia
Disallow /south-korea
Disallow /macao
Disallow /malaysia
Disallow /philippines
Disallow /singapore
Disallow /thailand
Disallow /taiwan
Disallow /vietnam

Other Records

Field Value
sitemap https://www.compathy.net/sitemaps/sitemap.xml.gz

Comments

  • robotstxt.org
  • Ignore specific pages
  • NOTE: backward compatibility