I did not rotate it at all, just placed them and got lots of those defects.
In case anyone finds this in the future and has the same problem:
Target an existing glass block, hold R and select "copy rotation".
You can now create nice glass houses without any block problems.
