SEO Checklist: i fattori SEO da Ottimizzare

User-agent: Googlebot/2.1
Disallow: /nogoogle.html

Sitemap: http://www.mysite.com/sitemap.xml

#allow all CSS and JS files
allow: /*.css$
allow: /*.js$

#Alternatively you can explicitly disallow single pages
User-agent: *
Disallow: /~joe/junk.html
Disallow: /~joe/foo.html
Disallow: /~joe/bar.html

#Example 1: Block all, also sitemap
User-agent: *
Disallow: /

#Block a file estension
Disallow: /directory/*.estension

#Block specific folder
www.dominio.com/directory/subdirectory/chiave/subdirectory/
Disallow: /*/keyword/

#Block all url containing a specific word
www.dominio.com/1chiave.estensione
www.dominio.com/2chiave.estensione
www.dominio.com/chiave3.estensione
Disallow: /*keyword

#Block specific folder
www.dominio.com/1chiave1/
www.dominio.com/2chiave2/
www.dominio.com/chiave3/
Disallow: /*keyword*/

#Block a page without block the same page plus parameters
Disallow: /directory/file.estensione$
Disallow: /directory/file.pdf$

#Block all URL with parameters
Disallow: /*?

#Block all URL with “get” parameter
Disallow: /*?*

#To exclude all robots from part of the server
User-agent: *
Disallow: /cgi-bin/
Disallow: /tmp/
Disallow: /junk/

#To exclude a single robot
User-agent: BadBot
Disallow: /

#To allow only Googlebot
User-agent: Google
Disallow:
User-agent: *
Disallow: /

#To exclude all robots from the entire server
User-agent: *
Disallow: /

#To exclude all files except one
#This is currently a bit awkward, as there is no “Allow” field. The easy way is to put all files to be disallowed into a separate directory, say “stuff”, and leave the #one #file in the level above this directory:
User-agent: *
Disallow: /~joe/stuff/

#To allow all robots complete access
User-agent: *
Disallow:

A 302 redirect is a temporary redirect. It passes 0% of link juice (ranking power) and, in most cases, should not be used. The Internet runs on a protocol called HyperText Transfer Protocol (HTTP) which dictates how URLs work. It has two major versions, 1.0 and 1.1. In the first version, 302 referred to the status code “Moved Temporarily.” This was changed in version 1.1 to mean “Found.”

A 307 redirect is the HTTP 1.1 successor of the 302 redirect. While the major crawlers will treat it like a 302 in some cases, it is best to use a 301 for almost all cases. The exception to this is when content is really moved only temporarily (such as during maintenance) AND the server has already been identified by the search engines as 1.1 compatible. Since it’s essentially impossible to determine whether or not the search engines have identified a page as compatible, it is generally best to use a 302 redirect for content that has been temporarily moved.