g2g.com
robots.txt
Robots Exclusion Standard data for g2g.com
Resource Scan
Scan Details
Site Domain | g2g.com |
Base Domain | g2g.com |
Scan Status | Ok |
Last Scan | 2024-05-08T03:19:46+00:00 |
Next Scan | 2024-05-22T03:19:46+00:00 |
Last Scan
Scanned | 2024-05-08T03:19:46+00:00 |
URL | https://g2g.com/robots.txt |
Redirect | https://www.g2g.com/robots.txt |
Redirect Domain | www.g2g.com |
Redirect Base | g2g.com |
Domain IPs | 108.156.133.13, 108.156.133.44, 108.156.133.50, 108.156.133.75 |
Redirect IPs | 13.225.4.12, 13.225.4.61, 13.225.4.74, 13.225.4.8 |
Response IP | 13.225.4.12 |
Found | Yes |
Hash | 46b2816d0b99ab7e09895404298769bae58b9a4b97bb81fd31f4cfcfef9e364e |
SimHash | 25ddc5b36573 |
Groups
*
Rule | Path |
---|---|
Allow | /account/sellerRegister |
Disallow | /ref-*/ |
Disallow | /id/ref-*/ |
Disallow | /zh-CN/ref-*/ |
Disallow | /checkout/buyNow/offerList |
Disallow | /*/checkout/buyNow/offerList |
Disallow | /sso/ |
Disallow | /id/sso/ |
Disallow | /zh-CN/sso/ |
Disallow | /search/ |
Disallow | /seller-search |
Disallow | /site/viewimage/ |
Disallow | /account/ |
Disallow | /offer/ |
Disallow | /login |
Disallow | /r/ |
Disallow | /categories/*/buy/ |
Disallow | /my/categories/*/buy/ |
Disallow | /sg/categories/*/buy/ |
Disallow | /id/categories/*/buy/ |
Disallow | /au/categories/*/buy/ |
Disallow | /uk/categories/*/buy/ |
Disallow | /kr/categories/*/buy/ |
Disallow | /cn/categories/*/buy/ |
Disallow | /categories/*/offer/ |
Disallow | /my/categories/*/offer/ |
Disallow | /sg/categories/*/offer/ |
Disallow | /id/categories/*/offer/ |
Disallow | /au/categories/*/offer/ |
Disallow | /uk/categories/*/offer/ |
Disallow | /kr/categories/*/offer/ |
Disallow | /cn/categories/*/offer/ |
Disallow | /categories/*-new$ |
Disallow | /categories/*-old$ |
Disallow | /my/categories/*-new$ |
Disallow | /my/categories/*-old$ |
Disallow | /sg/categories/*-new$ |
Disallow | /sg/categories/*-old$ |
Disallow | /id/categories/*-new$ |
Disallow | /id/categories/*-old$ |
Disallow | /au/categories/*-new$ |
Disallow | /au/categories/*-old$ |
Disallow | /uk/categories/*-new$ |
Disallow | /uk/categories/*-old$ |
Disallow | /kr/categories/*-new$ |
Disallow | /kr/categories/*-old$ |
Disallow | /cn/categories/*-new$ |
Disallow | /cn/categories/*-old$ |
Disallow | /signup |
Disallow | /AU/categories/ |
Disallow | /*?*seller= |