You have it backwards. PG agrees that you can't conclude from the fact that something is beautiful that it's also right--he says "we can't safely conclude that beautiful writing is true".
What PG is saying is that if something is ugly, you can conclude that it's most likely wrong as well.
What PG is saying is that if something is ugly, you can conclude that it's most likely wrong as well.