No, there's no straightforward way of doing this at present. You'd need to set SERVER_MODE = False in the config before the first time the container is run (as it affects the config DB that's created at first startup), but there isn't a simple way to do that at the moment.
You could create a dockerfile to create your own version of the container that did something like:
---- FROM pgadmin4:latest COPY config_local.py /pgadmin4 ----
Where config_local.py included the SERVER_MODE override.