I usually take the tikz-pgfplot route through gnuplot-lua interface to draw scientific figures for research papers. It usually works very good and I can seamlessly integrate my figures in latex documents. The figures thus produced is very high resolution and refined. However, the stumbling block is the high-resolution scatterplot of a large dataset - to tune of 100,000 points.
If I follow my usual tikz-pgfplot route, the latex file is produced but while compiling through pdflatex, one gets the tex memory exceeded... error. I also came to know that increasing tex's memory is not a good idea. So, I ended up producing an eps (encapsulated postscript) figure, which I then include in my latex document through tikz-pgfplot to render the annotations. It usually works but results a very large PDF file to the tune of 2 MB for a small figure and the PDF reader take long time to fully display figure.
I was wondering, if there any other ways to produce a high-resolution scatterplot of a large dataset? Any pointer would be highly appreciated.
Madhur