gotoshop.net.ua
robots.txt

Robots Exclusion Standard data for gotoshop.net.ua

Resource Scan

Scan Details

Site Domain gotoshop.net.ua
Base Domain gotoshop.net.ua
Scan Status Ok
Last Scan2024-11-13T23:09:47+00:00
Next Scan 2024-11-20T23:09:47+00:00

Last Scan

Scanned2024-11-13T23:09:47+00:00
URL https://gotoshop.net.ua/robots.txt
Redirect https://gotoshop.ua/robots.txt
Redirect Domain gotoshop.ua
Redirect Base gotoshop.ua
Domain IPs 104.21.37.14, 172.67.202.104, 2606:4700:3030::ac43:ca68, 2606:4700:3031::6815:250e
Redirect IPs 104.26.10.237, 104.26.11.237, 172.67.72.183, 2606:4700:20::681a:aed, 2606:4700:20::681a:bed, 2606:4700:20::ac43:48b7
Response IP 172.67.72.183
Found Yes
Hash a99c7a42567c5f3756d38ff3723dcc1d71607838bc24c5d2434d8171735620c4
SimHash 2d1a9a3f03d8

Groups

*

Rule Path
Disallow /product/ajaxgetnewdata/
Disallow /ajax/ajaxgetfixedtabshtml/
Disallow /ru/product/ajaxgetnewdata/
Disallow /ru/ajax/ajaxgetfixedtabshtml/
Disallow /apiv3/
Disallow /ru/apiv3/
Disallow /apiv2/
Disallow /ru/apiv2/
Disallow /apiv4/
Disallow /uk/apiv3/
Disallow /ampajax/ajaxgetfavdropdown/
Disallow /ampajax/ajaxgetuserinfo/
Disallow /uk/apiv4/products/
Disallow /uk/apiv2/catalogs/
Disallow /uk/ampajax/ajaxgetfavdropdown/
Disallow /uk/ampajax/ajaxgetuserinfo/
Disallow *?changelang
Disallow /*/products
Disallow *?orderby
Disallow *?time
Disallow /ajax/
Disallow /uk/ajax/
Disallow /ru/ajax/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60