exboxgr.com
robots.txt

Robots Exclusion Standard data for exboxgr.com

Resource Scan

Scan Details

Site Domain exboxgr.com
Base Domain exboxgr.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-09-19T02:42:10+00:00
Next Scan 2025-12-18T02:42:10+00:00

Last Successful Scan

Scanned2022-11-09T11:12:31+00:00
URL https://exboxgr.com/robots.txt
Redirect https://www.gonesgr.com/robots.txt
Redirect Domain www.gonesgr.com
Redirect Base gonesgr.com
Response IP 104.17.232.29, 104.17.233.29
Found Yes
Hash 9441bd50f228fb2955ae5a222e765ca0d35f3ea56c03aff55977128d6becac17
SimHash 6d15de625501

Groups

*

Rule Path
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkout
Disallow /trade
Disallow /account
Disallow /user
Disallow /search
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

adsbot-google

Rule Path
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkout
Disallow /trade
Disallow /account
Disallow /user
Disallow /search
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkout
Disallow /trade
Disallow /account
Disallow /user
Disallow /search
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkout
Disallow /trade
Disallow /account
Disallow /user
Disallow /search
Disallow /transit_page
Disallow /api/merchant/payments/list
Disallow /api/trade/center/settle/main_site/detail/first_load
Disallow /preview
Disallow /%3Fpreview
Disallow /apple-app-site-association

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.gonesgr.com/sitemap.xml

Comments

  • Google adsbot ignores robots.txt unless specifically named!