yabiladi.ma
robots.txt

Robots Exclusion Standard data for yabiladi.ma

Resource Scan

Scan Details

Site Domain yabiladi.ma
Base Domain yabiladi.ma
Scan Status Ok
Last Scan2024-09-19T00:34:25+00:00
Next Scan 2024-09-26T00:34:25+00:00

Last Scan

Scanned2024-09-19T00:34:25+00:00
URL https://yabiladi.ma/robots.txt
Domain IPs 104.21.30.175, 172.67.173.123, 2606:4700:3031::6815:1eaf, 2606:4700:3032::ac43:ad7b
Response IP 104.21.30.175
Found Yes
Hash ead86f9e54721cb80c928e944dca9e664d100d0521837910689f7e9450b11bf6
SimHash 2530c241ed21

Groups

proximic

Rule Path
Disallow /

exabot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Allow /
Disallow /articles/printview/
Disallow /mobile/
Disallow /prieres2/
Disallow /account/
Disallow /comments/
Disallow /forum/control/
Disallow /rencontres/account/
Disallow /old/
Disallow /es/
Disallow /ar/
Disallow /pub.php
Disallow /adsense.php
Disallow /forum/search.php
Disallow /m/
Disallow /articles/search/
Disallow /articles/advanced/
Disallow /rencontres/profile.php
Disallow /files/radio
Disallow /mp
Disallow /nav
Disallow /annonces/redirection/

mediapartners-google

Rule Path
Allow /

Warnings

  • 2 invalid lines.