naijaparrot.com
robots.txt

Robots Exclusion Standard data for naijaparrot.com

Resource Scan

Scan Details

Site Domain naijaparrot.com
Base Domain naijaparrot.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-01-22T22:04:31+00:00
Next Scan 2025-04-22T22:04:31+00:00

Last Successful Scan

Scanned2024-03-29T21:54:14+00:00
URL https://naijaparrot.com/robots.txt
Domain IPs 104.21.20.143, 172.67.192.247, 2606:4700:3031::6815:148f, 2606:4700:3036::ac43:c0f7
Response IP 104.21.20.143
Found Yes
Hash 3a3a18e0e961cbe50a712207ceafac9594831fb8384b9e75abb9621ead6f73d7
SimHash 003cc9ea2aba

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes/
Allow /wp-includes/js/
Allow /wp-includes/images/
Disallow /trackback/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /?blackhole
Disallow /*blackhole
Disallow /cgi-bin
Disallow /wp-
Disallow /?s=
Disallow *%26s%3D
Disallow /search
Disallow /author/
Disallow *?attachment_id=
Disallow */feed
Disallow */rss
Disallow */embed
Allow /wp-content/uploads/
Allow /wp-content/themes/
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-*.svg
Allow /wp-*.pdf

semrushbot

Rule Path
Disallow /

semrush

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /