I'd be inclined to leave it there, simply because you'll be changing the conditions of the benchmark if you take it out. I have not noticed any particular problems with it...
The only problem I faced is while executing custom scripts using pgbench. You either need to do the initialization (pgbench -i) or run with -n option (no vacuum). But I don't have any strong preference here.