serbay.net
robots.txt

Robots Exclusion Standard data for serbay.net

Resource Scan

Scan Details

Site Domain serbay.net
Base Domain serbay.net
Scan Status Ok
Last Scan2024-06-10T11:33:40+00:00
Next Scan 2024-07-10T11:33:40+00:00

Last Scan

Scanned2024-06-10T11:33:40+00:00
URL https://serbay.net/robots.txt
Redirect https://www.serbay.net/robots.txt
Redirect Domain www.serbay.net
Redirect Base serbay.net
Domain IPs 104.21.20.226, 172.67.194.184, 2606:4700:3031::6815:14e2, 2606:4700:3036::ac43:c2b8
Redirect IPs 185.210.93.139, 185.210.93.140
Response IP 185.210.93.140
Found Yes
Hash 024f66f0907b04123ed5837f6a69277716baa8e3f554f964d777fb76421edf36
SimHash 6a14d407d533

Groups

googlebot
googlebot-video
adsbot-google
googlebot-mobile
googlebot-news
googlebot-image
googlebot-image/1.0
mediapartners-google
slurp
yahoo! slurp
yahoo-mmcrawler
msnbot
twitterbot
yandexbot
yandeximages
yandex
bingbot
applebot
ia_archiver
baiduspider
naverbot
seznambot
teoma
yeti
grapeshot
linklooker
enigmabot
ninjabot
ahrefsbot
duckduckbot
facebookexternalhit
icc-crawler
pinterest
bspider
exabot
exabot-images
ocelli
ichiro
archive.org_bot
heritrix
httrack
jakarta commons-httpclient
jbot
magpierss
mail.ru
mj12bot
nutch
phantom
python-urllib
sogou develop spider
sogou orion spider
sogou spider
sogou web spider
sohu agent
turnitinbot
web core / roots
yandexmetrika
*

Rule Path
Allow /
Allow /resim/*
Allow /resim/upload/*
Allow /resim/upload/

Warnings

  • 2 invalid lines.