pinoymoviepedia.ru
robots.txt

Robots Exclusion Standard data for pinoymoviepedia.ru

Archived Snapshots

Resource Scan

Scan Details

Site Domain	pinoymoviepedia.ru
Base Domain	pinoymoviepedia.ru
Scan Status	Ok
Last Scan	4/15/2025, 7:14:32 AM
Next Scan	5/15/2025, 7:14:32 AM

Last Scan

Scanned	4/15/2025, 7:14:32 AM
URL	https://pinoymoviepedia.ru/robots.txt
Domain IPs	104.21.28.3, 172.67.170.28, 2606:4700:3034::ac43:aa1c, 2606:4700:3035::6815:1c03
Response IP	104.21.28.3
Found	Yes
Hash	00958515dd6240a78a34e1319d1172eeebe1807155776e3757011730e075c0be
SimHash	50247d42ccd2

Groups

mail.ru

No rules defined. All paths allowed.

Other Records

Field	Value
crawl-delay	30

Field

Value

crawl-delay

baiduspider

No rules defined. All paths allowed.

Other Records

Field	Value
crawl-delay	30

Field

Value

crawl-delay

msnbot

No rules defined. All paths allowed.

Other Records

Field	Value
crawl-delay	7

Field

Value

crawl-delay

bingbot

No rules defined. All paths allowed.

Other Records

Field	Value
crawl-delay	7

Field

Value

crawl-delay

slurp

No rules defined. All paths allowed.

Other Records

Field	Value
crawl-delay	7

Field

Value

crawl-delay

yandex

No rules defined. All paths allowed.

Other Records

Field	Value
crawl-delay	2

Field

Value

crawl-delay

*

Rule	Path
Disallow	/wp-json/
Disallow	/?rest_route=

Rule

Path

Disallow

/wp-json/

Disallow

/?rest_route=

*

Rule	Path	Comment
Disallow	/search/	-
Disallow	/?s=	-
Disallow	/?get=	-
Disallow	/?filter=	-
Disallow	/account/?action=log-in	-
Disallow	/links/	-
Disallow	*/links/	-
Disallow	/?s=%7Bsearch_term_string%7D	-
Disallow	/?asgtbndr=1	-
Disallow	/cdn-cgi/	-
Disallow	/?filter=latest	!
Disallow	/?filter=most-viewed	!
Disallow	/?filter=most-viewed	-
Disallow	/cdn-cgi/challenge-platform/h/g/scripts/alpha/invisible.js?ts=	-
Disallow	/cdn-cgi/challenge-platform/h/b	-
Disallow	/cdn-cgi/challenge-platform/	-
Disallow	/wp-login.php?action=lostpassword	-
Disallow	/cdn-cgi/challenge-platform/h/b/scripts/alpha/invisible.js?ts=	-
Disallow	/wp-content/uploads/2023/07/Sosyal-	-
Disallow	/wp-content/uploads/2021/11/My-	-
Disallow	/wp-content/uploads/2019/12/Ang-	-
Disallow	/wp-content/uploads/2020/07/Cara-x-	-
Disallow	/splash.php	-
Disallow	/?get=movies	-
Allow	/*?$	-
Disallow	/*?	-

Rule

Path

Comment

Disallow

/search/

Disallow

/?s=

Disallow

/?get=

Disallow

/?filter=

Disallow

/account/?action=log-in

Disallow

/links/

Disallow

*/links/

Disallow

/?s=%7Bsearch_term_string%7D

Disallow

/?asgtbndr=1

Disallow

/cdn-cgi/

Disallow

/?filter=latest

Disallow

/?filter=most-viewed

Disallow

/?filter=most-viewed

Disallow

/cdn-cgi/challenge-platform/h/g/scripts/alpha/invisible.js?ts=

Disallow

/cdn-cgi/challenge-platform/h/b

Disallow

/cdn-cgi/challenge-platform/

Disallow

/wp-login.php?action=lostpassword

Disallow

/cdn-cgi/challenge-platform/h/b/scripts/alpha/invisible.js?ts=

Disallow

/wp-content/uploads/2023/07/Sosyal-

Disallow

/wp-content/uploads/2021/11/My-

Disallow

/wp-content/uploads/2019/12/Ang-

Disallow

/wp-content/uploads/2020/07/Cara-x-

Disallow

/splash.php

Disallow

/?get=movies

Allow

/*?$

Disallow

/*?

*

Rule	Path
Disallow	?s=
Disallow	?p=
Disallow	%26p%3D
Disallow	%26preview%3D

Rule

Path

Disallow

*?s=*

Disallow

*?p=*

Disallow

*%26p%3D*

Disallow

*%26preview%3D*

*

Rule	Path
Disallow	/feed/
Disallow	/feed/$
Disallow	/comments/feed
Disallow	*/feed
Disallow	*/feed$
Disallow	/?feed=
Disallow	/wp-feed

Rule

Path

Disallow

/feed/

Disallow

/feed/$

Disallow

/comments/feed

Disallow

*/feed

Disallow

*/feed$

Disallow

/?feed=

Disallow

/wp-feed

*

Rule	Path
Disallow	/trackback/
Disallow	*/comments$
Disallow	*/trackback
Disallow	*/trackback$
Disallow	/wp-comments
Disallow	/wp-trackback
Disallow	*/replytocom%3D

Rule

Path

Disallow

/trackback/

Disallow

*/comments$

Disallow

*/trackback

Disallow

*/trackback$

Disallow

/wp-comments

Disallow

/wp-trackback

Disallow

*/replytocom%3D

ia_archiver

Rule	Path
Disallow	/

Rule

Path

Disallow

archive.org_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

ia_archiver-web.archive.org

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

*

Rule	Path
Disallow	/cart/

Rule

Path

Disallow

/cart/

*

Rule	Path
Disallow	/checkout/

Rule

Path

Disallow

/checkout/

*

Rule	Path
Disallow	/my-account/

Rule

Path

Disallow

/my-account/

*

Rule	Path
Disallow	/login/

Rule

Path

Disallow

/login/

*

Rule	Path
Disallow	/*?orderby=price
Disallow	/*?orderby=rating
Disallow	/*?orderby=date
Disallow	/*?orderby=price-desc
Disallow	/*?orderby=popularity
Disallow	/*?filter
Disallow	/*?orderby=title
Disallow	/*?orderby=desc
Disallow	/add-to-cart%3D
Disallow	/add_to_wishlist%3D
Disallow	/?paged=&count=
Disallow	/?count=

Rule

Path

Disallow

/*?orderby=price

Disallow

/*?orderby=rating

Disallow

/*?orderby=date

Disallow

/*?orderby=price-desc

Disallow

/*?orderby=popularity

Disallow

/*?filter

Disallow

/*?orderby=title

Disallow

/*?orderby=desc

Disallow

/*add-to-cart%3D*

Disallow

/*add_to_wishlist%3D*

Disallow

/*?paged=&count=*

Disallow

/*?count=*

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-sa

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-ba

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-si

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-swa

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-ct

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-bm

Rule	Path
Disallow	/

Rule

Path

Disallow

rogerbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

xenu

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

giftghostbot

Rule	Path
Disallow	/

Rule

Path

Disallow

seznam

Rule	Path
Disallow	/

Rule

Path

Disallow

paperlibot

Rule	Path
Disallow	/

Rule

Path

Disallow

genieo

Rule	Path
Disallow	/

Rule

Path

Disallow

dataprovider/6.101

Rule	Path
Disallow	/

Rule

Path

Disallow

dataprovidersiteexplorer

Rule	Path
Disallow	/

Rule

Path

Disallow

dazoobot/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

diffbot

Rule	Path
Disallow	/

Rule

Path

Disallow

domainstatsbot/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot/1.1

Rule	Path
Disallow	/

Rule

Path

Disallow

dubaiindex

Rule	Path
Disallow	/

Rule

Path

Disallow

ecommercebot

Rule	Path
Disallow	/

Rule

Path

Disallow

expertsearchspider

Rule	Path
Disallow	/

Rule

Path

Disallow

feedbin

Rule	Path
Disallow	/

Rule

Path

Disallow

fetch/2.0a

Rule	Path
Disallow	/

Rule

Path

Disallow

ffbot/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

focusbot/1.1

Rule

Path

Disallow

huaweisymantecspider

Rule

Path

Disallow

huaweisymantecspider/1.0

Rule

Path

Disallow

jobdiggerspider

Rule

Path

Disallow

lemurwebcrawler

Rule

Path

Disallow

lipperheylinkexplorer

Rule

Path

Disallow

lssrocketcrawler/1.0

Rule

Path

Disallow

lyt.srv1.5

Rule

Path

Disallow

miadev/0.0.1

Rule

Path

Disallow

najdi.si/3.1

Rule

Path

Disallow

bountiibot

Rule

Path

Disallow

experibot_v1

Rule

Path

Disallow

bixocrawler

Rule

Path

Disallow

bixocrawler testcrawler

Rule

Path

Disallow

crawler4j

Rule

Path

Disallow

crowsnest/0.5

Rule

Path

Disallow

cukbot

Rule

Path

Disallow

dataprovider/6.92

Rule

Path

Disallow

dblbot/1.0

Rule

Path

Disallow

diffbot/0.1

Rule

Path

Disallow

digg deeper/v1

Rule

Path

Disallow

discobot/1.0

Rule

Path

Disallow

discobot/1.1

Rule

Path

Disallow

discobot/2.0

Rule

Path

Disallow

discoverybot/2.0

Rule

Path

Disallow

dlvr.it/1.0

Rule

Path

Disallow

domainstatsbot/1.0

Rule

Path

Disallow

drupact/0.7

Rule

Path

Disallow

ezooms/1.0

Rule

Path

Disallow

fastbot crawler beta 2.0

Rule

Path

Disallow

fastbot crawler beta 4.0

Rule

Path

Disallow

feedly social

Rule

Path

Disallow

feedly/1.0

Rule

Path

Disallow

feedlybot/1.0

Rule

Path

Disallow

feedspot

Rule

Path

Disallow

feedspotbot/1.0

Rule

Path

Disallow

clickagy intelligence bot v2

Rule

Path

Disallow

classbot

Rule

Path

Disallow

cispa vulnerability notification

Rule

Path

Disallow

cirrusexplorer/1.1

Rule

Path

Disallow

checksem/nutch-1.10

Rule

Path

Disallow

catchbot/5.0

Rule

Path

Disallow

catchbot/3.0

Rule

Path

Disallow

catchbot/2.0

Rule

Path

Disallow

catchbot/1.0

Rule

Path

Disallow

camontspider/1.0

Rule

Path

Disallow

buzzbot/1.0

Rule

Path

Disallow

buzzbot

Rule

Path

Disallow

businessseek.biz_spider

Rule

Path

Disallow

bubing

Rule

Path

Disallow

fyberspider/1.3

Rule

Path

Disallow

findlinks/1.1.6-beta5

Rule

Path

Disallow

g2reader-bot/1.0

Rule

Path

Disallow

findlinks/1.1.6-beta6

Rule

Path

Disallow

findlinks/2.0

Rule

Path

Disallow

findlinks/2.0.1

Rule

Path

Disallow

findlinks/2.0.2

Rule

Path

Disallow

findlinks/2.0.4

Rule

Path

Disallow

findlinks/2.0.5

Rule

Path

Disallow

findlinks/2.0.9

Rule

Path

Disallow

findlinks/2.1

Rule

Path

Disallow

findlinks/2.1.5

Rule

Path

Disallow

findlinks/2.1.3

Rule

Path

Disallow

findlinks/2.2

Rule

Path

Disallow

findlinks/2.5

Rule

Path

Disallow

findlinks/2.6

Rule

Path

Disallow

ffbot/1.0

Rule

Path

Disallow

findlinks/1.0

Rule

Path

Disallow

findlinks/1.1.3-beta8

Rule

Path

Disallow

findlinks/1.1.3-beta9

Rule

Path

Disallow

findlinks/1.1.4-beta7

Rule

Path

Disallow

findlinks/1.1.6-beta1

Rule

Path

Disallow

findlinks/1.1.6-beta1 yacy

Rule

Path

Disallow

findlinks/1.1.6-beta2

Rule

Path

Disallow

findlinks/1.1.6-beta3

Rule

Path

Disallow

findlinks/1.1.6-beta4

Rule

Path

Disallow

bixo

Rule

Path

Disallow

bixolabs/1.0

Rule

Path

Disallow

crawlera/1.10.2

Rule

Path

Disallow

dataprovider site explorer

Rule

Path

Disallow

Other Records

Field

Value

sitemap

https://pinoymoviepedia.ru/post-sitemap.xml

sitemap

https://pinoymoviepedia.ru/page-sitemap.xml

sitemap

https://pinoymoviepedia.ru/sitemap_index.xml

Comments

Prevent Crawling of WordPress JSON API Endpoints
Block Search URLs /search/ and /?s=
Block Parameters
Block Feed
Block Spam Directories
Block archive.org bots
Block Chatgpt
Block Cart Page
Block Checkout Page
Block My Account Page
Block Login Page
Block Woocommerce Parameters
Rankmath Sitemap Link
Block Ahrefs Crawler
Block Semrush Crawler
Block Moz Crawler
Block Majestic Crawler
Block Xenu Crawler
Block Scrapper Bots

Warnings

23 invalid lines.

pinoymoviepedia.rurobots.txt

Resource Scan

Scan Details

Last Scan

Groups

mail.ru

Other Records

baiduspider

Other Records

msnbot

Other Records

bingbot

Other Records

slurp

Other Records

yandex

Other Records

*

*

*

*

*

ia_archiver

archive.org_bot

ia_archiver-web.archive.org

ccbot

*

*

*

*

*

ahrefsbot

semrushbot

semrushbot-sa

semrushbot-ba

semrushbot-si

semrushbot-swa

semrushbot-ct

semrushbot-bm

rogerbot

mj12bot

xenu

dotbot

giftghostbot

seznam

paperlibot

genieo

dataprovider/6.101

dataprovidersiteexplorer

dazoobot/1.0

diffbot

domainstatsbot/1.0

dotbot/1.1

dubaiindex

ecommercebot

expertsearchspider

feedbin

fetch/2.0a

ffbot/1.0

focusbot/1.1

huaweisymantecspider

huaweisymantecspider/1.0

jobdiggerspider

lemurwebcrawler

lipperheylinkexplorer

lssrocketcrawler/1.0

lyt.srv1.5

miadev/0.0.1

najdi.si/3.1

bountiibot

experibot_v1

bixocrawler

bixocrawler testcrawler

crawler4j

crowsnest/0.5

cukbot

dataprovider/6.92

dblbot/1.0

diffbot/0.1

digg deeper/v1

pinoymoviepedia.ru
robots.txt