akhbar24.news
robots.txt

Robots Exclusion Standard data for akhbar24.news

Resource Scan

Scan Details

Site Domain akhbar24.news
Base Domain akhbar24.news
Scan Status Ok
Last Scan2024-05-27T13:33:12+00:00
Next Scan 2024-06-03T13:33:12+00:00

Last Scan

Scanned2024-05-27T13:33:12+00:00
URL https://akhbar24.news/robots.txt
Redirect https://7.akhbara24.news/robots.txt
Redirect Domain 7.akhbara24.news
Redirect Base akhbara24.news
Domain IPs 51.91.119.25
Redirect IPs 104.21.82.62, 172.67.197.110, 2606:4700:3030::ac43:c56e, 2606:4700:3036::6815:523e
Response IP 172.67.197.110
Found Yes
Hash 2d777d8607f0c3e9e2ef0d5d21819ae5117bd39f7d9a34da6ec00d1d42758551
SimHash 60194b22f606

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /linkout/
Disallow /recommended/
Disallow /comments/feed/
Disallow /trackback/
Disallow /index.php
Disallow /xmlrpc.php
Disallow /n/*

*

Rule Path
Disallow /p/a*
Disallow /p/b*
Disallow /p/c*
Disallow /p/d*
Disallow /p/e*
Disallow /p/f*
Disallow /p/g*
Disallow /p/h*
Disallow /p/i*
Disallow /p/j*
Disallow /p/k*
Disallow /p/l*
Disallow /p/m*
Disallow /p/n*
Disallow /p/o*
Disallow /p/p*
Disallow /p/q*
Disallow /p/r*
Disallow /p/s*
Disallow /p/t*
Disallow /p/u*
Disallow /p/v*
Disallow /p/w*
Disallow /p/x*
Disallow /p/y*
Disallow /p/z*
Disallow /p/1*
Disallow /p/2*
Disallow /p/3*
Disallow /p/4*
Disallow /p/5*
Disallow /p/6*
Disallow /p/7*
Disallow /p/8*
Disallow /p/9*
Disallow /p/0*
Disallow /album/*
Disallow /download/*
Disallow /player.php
Disallow /find.php
Disallow /ydls.php

ninjabot

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

Other Records

Field Value
sitemap https://akhbar24.news//sitemap_index.xml