pegemkampus.com
robots.txt

Robots Exclusion Standard data for pegemkampus.com

Resource Scan

Scan Details

Site Domain pegemkampus.com
Base Domain pegemkampus.com
Scan Status Ok
Last Scan2024-09-29T03:58:10+00:00
Next Scan 2024-10-29T03:58:10+00:00

Last Scan

Scanned2024-09-29T03:58:10+00:00
URL https://pegemkampus.com/robots.txt
Domain IPs 185.226.160.220
Response IP 185.226.160.220
Found Yes
Hash afea368bb50472e1fce21fd9703ff31c66ae54601ebb3b46cfc19e0dad0b4957
SimHash 615cfb22d0b5

Groups

mj12bot

Rule Path
Disallow /

baiduspiders

Rule Path
Disallow /

nerdybot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /*?=fblogin*
Disallow /*?=googlelogin*
Disallow /uye-girisi
Disallow /uye-ol
Disallow /uye/sepet
Disallow /sifremi-unuttum
Disallow /hesabim
Disallow /admin/
Disallow /ajax/productcomments
Disallow /ajax/productfeature
Disallow /ajax/productsimilar
Disallow /ajax/productinstallments

Other Records

Field Value
crawl-delay 20

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Warnings

  • 2 invalid lines.