aria/FMHY-Website
1
0
Fork 0
mirror of https://github.com/fmhy/edit.git synced 2025-10-13 00:01:09 +11:00
Code Issues Projects Releases Packages Wiki Activity Actions

Update robots.txt (#3941)

Browse source 
* update robots.txt

disallow crawlers from /assets/
they treat it as junk/bad content

* Update robots.txt

make it so image files in the base directory don't get indexed
This commit is contained in:
Royiex 2025-08-17 02:52:54 +02:00 • committed by GitHub
parent a3a2fa7173
commit 49f816991d
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 3 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

3
docs/public/robots.txt
View file

@ -1,3 +1,6 @@
User-agent: * User-agent: *
Disallow: /assets/ Disallow: /assets/
Disallow: /*.png$
Disallow: /*.svg$
Disallow: /*.ico$
Allow: / Allow: /