fr.legit.ng
robots.txt

Robots Exclusion Standard data for fr.legit.ng

Resource Scan

Scan Details

Site Domain fr.legit.ng
Base Domain legit.ng
Scan Status Ok
Last Scan2024-11-13T01:56:29+00:00
Next Scan 2024-11-20T01:56:29+00:00

Last Scan

Scanned2024-11-13T01:56:29+00:00
URL https://fr.legit.ng/robots.txt
Domain IPs 184.87.193.86, 184.87.193.97
Response IP 23.45.207.172
Found Yes
Hash e860190a41986a6f5840b995c9e20babb0e53d3174fc1eb926e83e67e4ff2140
SimHash 69418641c914

Groups

*

Rule Path
Disallow */away.php?
Disallow */redirect.php?
Disallow /fb_comment_id%3D*
Disallow */maillist/*
Disallow */resource/*
Disallow /member.php*
Disallow *?new_letter
Disallow */feedback.php*
Disallow /?preview_id
Disallow /?pk_campaign=*
Disallow /newsfeed
Disallow /app-landing/
Disallow /pay.html
Disallow /widget4/
Disallow /legit/speed_test.html
Disallow /ajax/visit/
Disallow /ajax/recommendation/
Disallow /authors/*?*
Disallow /authors/*?page=*&*
Allow /authors/*?page=*$

Other Records

Field Value
sitemap https://fr.legit.ng/legit/sitemap/fr/sitemap.xml
sitemap https://fr.legit.ng/legit/sitemap/fr/news.xml
sitemap https://fr.legit.ng/legit/sitemap/fr/category-sitemap.xml
sitemap https://fr.legit.ng/legit/sitemap/fr/tag-sitemap.xml
sitemap https://fr.legit.ng/legit/sitemap/fr/author-sitemap.xml
sitemap https://fr.legit.ng/legit/sitemap/fr/expert-sitemap.xml
sitemap https://fr.legit.ng/legit/sitemap/fr/static-sitemap.xml