newauction.org
robots.txt

Robots Exclusion Standard data for newauction.org

Resource Scan

Scan Details

Site Domain newauction.org
Base Domain newauction.org
Scan Status Ok
Last Scan2024-10-03T06:06:54+00:00
Next Scan 2024-10-10T06:06:54+00:00

Last Scan

Scanned2024-10-03T06:06:54+00:00
URL https://newauction.org/robots.txt
Domain IPs 162.19.198.228
Response IP 162.19.198.228
Found Yes
Hash 453f123e45f20bbefe6d1921efc0e6c6173b9419e2f7a2f8489a1a4284a71496
SimHash aef61abc8e56

Groups

*

Rule Path
Disallow /stub/
Disallow /registration
Disallow /auth
Disallow /cart
Disallow /contact_form*
Disallow /new_offer
Disallow /cabinet/
Disallow /askseller*
Disallow /password*
Disallow /ajax
Disallow /js/ServerDate.js*
Disallow /redirect*
Disallow /agreement
Disallow /staticpage/doc/rules*
Disallow /*utm_source%3D
Disallow /*srt_
Disallow /*flt_
Disallow /*spush%3D
Disallow /*match_excluded_cat%3D
Disallow /new_order*
Disallow /*language%3D
Disallow /ru/stub/
Disallow /ru/registration
Disallow /ru/auth
Disallow /ru/cart
Disallow /ru/contact_form*
Disallow /ru/new_offer
Disallow /ru/cabinet/
Disallow /ru/askseller*
Disallow /ru/password*
Disallow /ru/ajax
Disallow /ru/js/ServerDate.js*
Disallow /ru/redirect*
Disallow /ru/agreement
Disallow /ru/staticpage/doc/rules*
Disallow /ru/*utm_source%3D
Disallow /ru/*srt_
Disallow /ru/*flt_
Disallow /ru/*spush%3D
Disallow /ru/*match_excluded_cat%3D
Disallow /ru/new_order*
Disallow /ru/*language%3D

icc-crawler

Rule Path
Disallow /

Warnings

  • `host` is not a known field.