freekaamaal.com
robots.txt

Robots Exclusion Standard data for freekaamaal.com

Resource Scan

Scan Details

Site Domain freekaamaal.com
Base Domain freekaamaal.com
Scan Status Ok
Last Scan2024-09-23T09:41:46+00:00
Next Scan 2024-09-30T09:41:46+00:00

Last Scan

Scanned2024-09-23T09:41:46+00:00
URL https://freekaamaal.com/robots.txt
Domain IPs 104.21.4.23, 172.67.131.144, 2606:4700:3033::ac43:8390, 2606:4700:3037::6815:417
Response IP 172.67.131.144
Found Yes
Hash cc8792fd686987defeafaf63c24dd85f72a6cb2de89505d7332f776d0e2fbcbb
SimHash 6d3dc7657691

Groups

mediapartners-google
googlebot
googlebot-image
googlebot-mobile
googlebot-news
msnbot
baiduspider
bingbot
slurp
yahoo-blogs/v3.9
*

Rule Path
Disallow /links/
Disallow /links?
Disallow /links?url=
Disallow /?*
Disallow /page/
Disallow /o/
Disallow /tag/
Disallow /brand/
Disallow /deals/
Disallow /fkmapplanfingpage/
Disallow /Offers/
Disallow /store/redirect/*
Disallow /discussion/*
Disallow /user/*
Disallow /r/*
Disallow /us/redirect/*
Disallow /live-feed/*
Allow /feed/

Other Records

Field Value
sitemap https://freekaamaal.com/sitemap-index.xml
sitemap https://freekaamaal.com/article.xml
sitemap https://freekaamaal.com/blog/sitemap.xml
sitemap https://freekaamaal.com/webstory.xml