So, I have read about this problem pretty much in every other thread in this subforum on programming, and I too have the same problem. I run a Python script (the language at least is different), which takes some data, manipulates it, and outputs a file. In theory. In practice if the input file is too large it only outputs part of the result, because the process gets killed. And since we are speaking of an xml file, half a file is no good at all. Like nothing at all.
Is there any way around this. It is fairly important. I cannot run it on my computer, as it is part of the service that I am trying to build on my website. I tried to 'nice' it, but maybe I wasn't nice enough, as it got killed again... on exactly the same point. Thus I assume it must be a problem with the memory.
Is there anything else that can be done? Is dreamhost available to be bribed, we pay more, and you give us more ram space. Or similar. I considered making the whole program really into basic steps, all stored in the directory, and jusy pick up the data for one process, make one calculation, and store the new data. But it is a massive work, and at the end it will be way more disrutive for dreamhost. Plus it would require make some sort of cron job work every minute to check if there is any work that needs to be done.
Anybody have other suggestions?
Dreamhost seem to offer such a good hosting service, but if it is not possible to scale up in this respect it is actually really limited.
Any suggestion would be appreciated.