My problem was that this site is rated G, but I rated my gravatar as PG. (For others: there are PG/G/R/X)
Have you assigned the image to your email address? It must match up. You might need to click an extra button somewhere that says "use this image" or something.
