gonesgr.com
robots.txt

Robots Exclusion Standard data for gonesgr.com

Resource Scan

Scan Details

Site Domain gonesgr.com
Base Domain gonesgr.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-26T07:28:14+00:00
Next Scan 2026-01-24T07:28:14+00:00

Last Successful Scan

Scanned2022-12-17T11:35:46+00:00
URL https://gonesgr.com/robots.txt
Domain IPs 104.17.232.29
Response IP 104.17.232.29
Found Yes
Hash f1d7ca36e3ec4a2b783a4499a0a07e2db26ec2fec3fc6a62a367e1aa1affab49
SimHash 6d15da625501

Groups

*

Rule Path
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkout
Disallow /trade
Disallow /account
Disallow /user
Disallow /search
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

adsbot-google

Rule Path
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkout
Disallow /trade
Disallow /account
Disallow /user
Disallow /search
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkout
Disallow /trade
Disallow /account
Disallow /user
Disallow /search
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkout
Disallow /trade
Disallow /account
Disallow /user
Disallow /search
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://gonesgr.com/sitemap.xml

Comments

  • Google adsbot ignores robots.txt unless specifically named!