harborc.com
robots.txt

Robots Exclusion Standard data for harborc.com

Resource Scan

Scan Details

Site Domain harborc.com
Base Domain harborc.com
Scan Status Ok
Last Scan2024-05-21T14:37:33+00:00
Next Scan 2024-06-20T14:37:33+00:00

Last Scan

Scanned2024-05-21T14:37:33+00:00
URL https://harborc.com/robots.txt
Redirect https://bursaescortlari.com/robots.txt
Redirect Domain bursaescortlari.com
Redirect Base bursaescortlari.com
Domain IPs 104.21.95.19, 172.67.169.43, 2606:4700:3031::6815:5f13, 2606:4700:3033::ac43:a92b
Redirect IPs 104.21.50.50, 172.67.157.29, 2606:4700:3033::ac43:9d1d, 2606:4700:3034::6815:3232
Response IP 104.21.50.50
Found Yes
Hash 5a43a56264e609f34e5612dfc69607d4224ee282d34fbedef955a40ae754329f
SimHash 04788e2bec9b

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Allow /
Disallow /cgi-sys/
Disallow /?sa*
Disallow /?asd*
Disallow /vb/*
Disallow /ajans/*
Disallow /trackback/
Disallow /archives/
Disallow /demo/
Disallow /*ref*
Disallow /*ref%3D/
Disallow /*?ref=%2F
Disallow /*?id=%2F
Disallow /?*
Disallow /*?dd%2F
Disallow /*?da%2F
Disallow /*?sa%2F
Disallow /*?ma%2F
Disallow /*?na%2F
Disallow /info/
Disallow /?s=%2F
Disallow /cgi-bin/
Disallow /*?child%2F
Disallow /*?amp%2F
Disallow /*?href%2F
Disallow /*?porn%2F
Disallow /*?childporno%2F
Disallow /*?porno%2F
Disallow /wp-/
Disallow /wp/
Disallow /author/
Disallow /*?replytocom%2F

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Allow /

ahrefsbot

Rule Path
Allow /

nerdybot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

dotbot

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

googlebot

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

Other Records

Field Value
sitemap https://bursaescortlari.com/sitemap.xml
sitemap https://bursaescortlari.com/sitemap.rss