yerelsecim.com
robots.txt

Robots Exclusion Standard data for yerelsecim.com

Resource Scan

Scan Details

Site Domain yerelsecim.com
Base Domain yerelsecim.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-05-02T15:41:31+00:00
Next Scan 2025-07-31T15:41:31+00:00

Last Successful Scan

Scanned2025-01-03T15:35:53+00:00
URL https://yerelsecim.com/robots.txt
Domain IPs 104.21.12.154, 172.67.132.45, 2606:4700:3030::6815:c9a, 2606:4700:3035::ac43:842d
Response IP 104.21.12.154
Found Yes
Hash e5181dccf7697fcf627ca04b41e8b85aa9503497024c9f6c9969883502069cee
SimHash c42d498c6bd1

Groups

*
googlebot
mediapartners-google*

Rule Path
Disallow

bizbot04 kirk.overleaf.com
happybot (gserver.kw.net)
californiabrownspider
ei*net/0.1 libwww/0.1
ibot/1.0 libwww-perl/0.40
merritt/1.0
statfetcher/1.0
teachersoft/1.0 libwww/2.17
www collector
processor/0.0alpha libwww-perl/0.20
wobot/1.0 from 206.214.202.45
libertech-rover www.libertech.com?
whowhere robot
iti spider
w3index
mycnnspider
summycrawler
ogspider
linklooker
cyberspyder (amant@www.cyberspyder.com)
slowbot
heraspider
surfbot
bizbot003
webwalker
sandbot
enigmabot
spyder3.microsys.com
www.freeloader.com.

No rules defined. All paths allowed.

Other Records

Field Value
sitemap http://www.yerelsecim.com/sitemap.asp