hausa.naija.ng
robots.txt

Robots Exclusion Standard data for hausa.naija.ng

Resource Scan

Scan Details

Site Domain hausa.naija.ng
Base Domain naija.ng
Scan Status Ok
Last Scan2024-10-26T17:14:14+00:00
Next Scan 2024-11-02T17:14:14+00:00

Last Scan

Scanned2024-10-26T17:14:14+00:00
URL https://hausa.naija.ng/robots.txt
Redirect https://hausa.legit.ng/robots.txt
Redirect Domain hausa.legit.ng
Redirect Base legit.ng
Domain IPs 23.209.46.74, 23.209.46.79
Redirect IPs 184.87.193.86, 184.87.193.97
Response IP 23.45.207.178
Found Yes
Hash 38de5e7393cf22bb654093fa6515c52bfb7d73138f96c899d4048385ef2a7bbd
SimHash 79600e03a915

Groups

*

Rule Path
Disallow */away.php?
Disallow */redirect.php?
Disallow /fb_comment_id%3D*
Disallow */maillist/*
Disallow */resource/*
Disallow /member.php*
Disallow *?new_letter
Disallow */feedback.php*
Disallow /?preview_id
Disallow /?pk_campaign=*
Disallow /newsfeed
Disallow /app-landing/
Disallow /pay.html
Disallow /widget4/
Disallow /legit/speed_test.html
Disallow /ajax/visit/
Disallow /ajax/recommendation/
Disallow /authors/*?*
Disallow /authors/*?page=*&*
Allow /authors/*?page=*$

Other Records

Field Value
sitemap https://hausa.legit.ng/legit/sitemap/hausa/sitemap.xml
sitemap https://hausa.legit.ng/legit/sitemap/hausa/news.xml
sitemap https://hausa.legit.ng/legit/sitemap/hausa/category-sitemap.xml
sitemap https://hausa.legit.ng/legit/sitemap/hausa/tag-sitemap.xml
sitemap https://hausa.legit.ng/legit/sitemap/hausa/author-sitemap.xml
sitemap https://hausa.legit.ng/legit/sitemap/hausa/expert-sitemap.xml
sitemap https://hausa.legit.ng/legit/sitemap/hausa/static-sitemap.xml