bizdesohbet.com
robots.txt

Robots Exclusion Standard data for bizdesohbet.com

Resource Scan

Scan Details

Site Domain bizdesohbet.com
Base Domain bizdesohbet.com
Scan Status Ok
Last Scan2024-09-23T06:18:28+00:00
Next Scan 2024-09-30T06:18:28+00:00

Last Scan

Scanned2024-09-23T06:18:28+00:00
URL https://bizdesohbet.com/robots.txt
Redirect https://www.bizdesohbet.com/robots.txt
Redirect Domain www.bizdesohbet.com
Redirect Base bizdesohbet.com
Domain IPs 185.26.145.94
Redirect IPs 185.26.145.94
Response IP 185.26.145.94
Found Yes
Hash e220ccf78f8445291b9f2f9f516f3f751e1cb82fd57b0511b2d27fbe6c9cb4a9
SimHash 6dd1df925590

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Allow /tmp/
Disallow /wp-admin/

googlebot

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

mediapartners

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

yandex

Rule Path
Allow /

yandexbot

Rule Path
Allow /

yandexmedia

Rule Path
Allow /

yandeximages

Rule Path
Allow /

yandexcatalog

Rule Path
Allow /

yandexdirect

Rule Path
Allow /

yandexblogs

Rule Path
Allow /

yandexnews

Rule Path
Allow /

yandexpagechecker

Rule Path
Allow /

httrack

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

youtube

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.bizdesohbet.com/news-sitemap.xml
sitemap https://www.bizdesohbet.com/video-sitemap.xml
sitemap https://www.bizdesohbet.com/sitemap.xml
sitemap https://www.bizdesohbet.com/sitemap.rss