oldboybarbershop.com
robots.txt

Robots Exclusion Standard data for oldboybarbershop.com

Resource Scan

Scan Details

Site Domain oldboybarbershop.com
Base Domain oldboybarbershop.com
Scan Status Ok
Last Scan2025-03-28T12:44:53+00:00
Next Scan 2025-04-27T12:44:53+00:00

Last Scan

Scanned2025-03-28T12:44:53+00:00
URL https://oldboybarbershop.com/robots.txt
Domain IPs 92.255.111.57
Response IP 92.255.111.57
Found Yes
Hash 90e78da9e8a6ba64d2639ca77f42a2b53431a9916ba8dd69b9e6b7949408efbf
SimHash 40489c470b02

Groups

*

Rule Path
Allow *.css
Allow *.js
Allow /yandex-rss
Allow /*.jpeg
Allow /*.jpg
Allow /*.png
Allow /*.webp
Disallow /core/
Disallow /profiles/
Disallow /README.txt
Disallow /web.config
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips
Disallow /node/add/
Disallow /search/
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /user/logout/
Disallow /index.php/admin/
Disallow /index.php/comment/reply/
Disallow /index.php/filter/tips
Disallow /index.php/node/add/
Disallow /index.php/search/
Disallow /index.php/user/password/
Disallow /index.php/user/register/
Disallow /index.php/user/login/
Disallow /index.php/user/logout/
Disallow */node/
Disallow *?
Disallow /sites/default/files/*.jpeg
Disallow *.pdf
Disallow /user/
Disallow /taxonomy/
Disallow /form/
Disallow *7929

clickfrogbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://oldboybarbershop.com/sitemap.xml