![](https://images.aicrowd.com/images/participants/image_file/default/2.png)
Location
Badges
Activity
Ratings Progression
Challenge Categories
Challenges Entered
Sample-efficient reinforcement learning in Minecraft
Latest submissions
See Allgraded | 25846 | ||
graded | 25845 | ||
failed | 25422 |
Participant | Rating |
---|
Participant | Rating |
---|
NeurIPS 2019 : MineRL Competition
![](https://images.aicrowd.com/100x100/images/participants/image_file/default/2.png)
Bug in submission?
About 5 years agoWhen I use the bash ./utility/docker_evaluation_locally.sh --verbose
, the following information is printed, I donβt how to remove the \r
from the shell script.
(base) ubuntu@ip-172-31-88-94:~/tmp/pycharm_project_22/competition_data$ ./utility/docker_evaluation_locally.sh --verbose
Note: Gathering environment variables from environ.sh
Building docker image, for skipping docker image build use ββno-buildβ
usage: aicrowd-repo2docker [-h] [βconfig CONFIG] [βjson-logs]
[βimage-name IMAGE_NAME] [βref REF] [βdebug]
[βno-build]
[βbuild-memory-limit BUILD_MEMORY_LIMIT]
[βno-run] [βpublish PORTS] [βpublish-all]
[βno-clean] [βpush] [βvolume VOLUMES]
[βuser-id USER_ID] [βuser-name USER_NAME]
[βenv ENVIRONMENT] [βeditable]
[βtarget-repo-dir TARGET_REPO_DIR]
[βappendix APPENDIX] [βsubdir SUBDIR] [βversion]
[βcache-from CACHE_FROM]
repo β¦
aicrowd-repo2docker: error: argument --image-name: βaicrowd/neurips2019-minerl-challenge\r:agent\rβ is not a valid docker image name. Image namemust start with an alphanumeric character andcan then use _ . or - in addition to alphanumeric.
To run your submission with nvidia drivers locally, use ββnvidiaβ with this script
βverbose
![](https://images.aicrowd.com/100x100/images/participants/image_file/default/2.png)
Suggestions about the competition startkit
About 5 years agoI think the competition startkit is not very clear, the upper bound of the submission time is 20, we donβt have enough chances to debug it.
- Your team can write a baseline (DQN, PPO) using startkit.
- Tell more details about the code format we should follow.
![](https://images.aicrowd.com/100x100/images/participants/image_file/default/2.png)
Problems about the competition startkit
About 5 years agoThe following is all of the logs, it prints the following information, then it is blocked. :
root@94d903ce99a4:/home/user/competition# xvfb-run -s β-ac -screen 0 1280x1024x24β ./new/evaluation_locally.sh --verbose
Verifying (and downloading) MineRL datasetβ¦
If you do not want to use the data:
run the local evaluation scripts with --no-data
If you want to use your existing download of the data:
make sure your MINERL_DATA_ROOT is set.
Data directory is data
Data verified! A+!
Not starting broadcast server for localhost.
NS running on localhost:9090 (127.0.0.1)
Warning: HMAC key not set. Anyone can connect to this server!
URI = PYRO:Pyro.NameServer@localhost:9090
WARNING:ray.rllib.utils.compression:lz4 not available, disabling sample compression. This will significantly impact RLlib performance. To install lz4, run pip install lz4
.
2019-09-02 13:02:43,092 WARNING worker.py:1337 β WARNING: Not updating worker name since setproctitle
is not installed. Install this with pip install setproctitle
(or ray[debug]) to enable monitoring of worker processes.
2019-09-02 13:02:43,093 INFO node.py:498 β Process STDOUT and STDERR is being redirected to /tmp/ray/session_2019-09-02_13-02-43_092903_72280/logs.
2019-09-02 13:02:43,210 WARNING services.py:763 β Redis failed to start, retrying now.
2019-09-02 13:02:43,329 INFO services.py:409 β Waiting for redis server at 127.0.0.1:23248 to respondβ¦
2019-09-02 13:02:43,448 INFO services.py:409 β Waiting for redis server at 127.0.0.1:12994 to respondβ¦
2019-09-02 13:02:43,451 INFO services.py:806 β Starting Redis shard with 10.0 GB max memory.
2019-09-02 13:02:43,477 INFO node.py:512 β Process STDOUT and STDERR is being redirected to /tmp/ray/session_2019-09-02_13-02-43_092903_72280/logs.
2019-09-02 13:02:43,477 WARNING services.py:1298 β Warning: Capping object memory store to 20.0GB. To increase this further, specify object_store_memory
when calling ray.init() or ray start.
2019-09-02 13:02:43,477 WARNING services.py:1323 β WARNING: The object store is using /tmp instead of /dev/shm because /dev/shm has only 67108864 bytes available. This may slow down performance! You may be able to free up space by deleting files in /dev/shm or terminating any running plasma_store_server processes. If you are inside a Docker container, you may need to pass an argument with the flag ββshm-sizeβ to βdocker runβ.
2019-09-02 13:02:43,478 INFO services.py:1446 β Starting the Plasma object store with 20.0 GB memory using /tmp.
2019-09-02 13:02:43,654 WARNING logger.py:139 β Couldnβt import TensorFlow - disabling TensorBoard logging.
2019-09-02 13:02:43,657 WARNING logger.py:233 β Could not instantiate <class βray.tune.logger.TFLoggerβ> - skipping.
WARNING:ray.rllib.utils.compression:lz4 not available, disabling sample compression. This will significantly impact RLlib performance. To install lz4, run pip install lz4
.
INFO:minerl.env.malmo.instance.84a92a:Starting Minecraft process: [β/tmp/tmp8___bykl/Minecraft/launchClient.shβ, β-portβ, β9081β, β-envβ, β-runDirβ, β/tmp/tmp8___bykl/Minecraft/runβ]
INFO:minerl.env.malmo.instance.84a92a:Starting process watcher for process 77277 @ localhost:9081
Exception in thread Thread-1:
Traceback (most recent call last):
File β/root/anaconda3/lib/python3.6/threading.pyβ, line 916, in _bootstrap_inner
self.run()
File β/root/anaconda3/lib/python3.6/threading.pyβ, line 864, in run
self._target(*self._args, **self._kwargs)
File β/root/anaconda3/lib/python3.6/site-packages/minerl/env/malmo.pyβ, line 896, in keep_alive_pyro
InstanceManager.add_keep_alive(os.getpid(), callback)
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 275, in getattr
self._pyroGetMetadata()
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 615, in _pyroGetMetadata
self.__pyroCreateConnection()
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 588, in __pyroCreateConnection
uri = _resolve(self._pyroUri, self._pyroHmacKey)
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 1911, in _resolve
return nameserver.lookup(uri.object)
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 185, in call
return self.__send(self.__name, args, kwargs)
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 476, in _pyroInvoke
raise data # if you see this in your traceback, you should probably inspect the remote traceback as well
Pyro4.errors.NamingError: unknown name: minerl.instance_manager
Traceback (most recent call last):
File βrun.pyβ, line 2, in
import train
File β/home/user/competition/train.pyβ, line 14, in
from envs import diamond_env_creator
File β/home/user/competition/envs.pyβ, line 10, in
from hack import minerl
File β/home/user/competition/hack.pyβ, line 74, in
minerl.env.malmo.InstanceManager.get_instance = get_instance
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 291, in setattr
self._pyroGetMetadata()
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 615, in _pyroGetMetadata
self.__pyroCreateConnection()
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 588, in __pyroCreateConnection
uri = _resolve(self._pyroUri, self._pyroHmacKey)
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 1911, in _resolve
return nameserver.lookup(uri.object)
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 185, in call
return self.__send(self.__name, args, kwargs)
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 476, in _pyroInvoke
raise data # if you see this in your traceback, you should probably inspect the remote traceback as well
Pyro4.errors.NamingError: unknown name: minerl.instance_manager
Β±-- This exception occured remotely (Pyro) - Remote traceback:
| Traceback (most recent call last):
| File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/naming.pyβ, line 91, in lookup
| uri, metadata = self.storage[name]
| KeyError: βminerl.instance_managerβ
|
| During handling of the above exception, another exception occurred:
|
| Traceback (most recent call last):
| File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 1421, in handleRequest
| data = method(*vargs, **kwargs) # this is the actual method call to the Pyro object
| File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/naming.pyβ, line 98, in lookup
| raise NamingError("unknown name: " + name)
| Pyro4.errors.NamingError: unknown name: minerl.instance_manager
Β±-- End of remote traceback
./new/evaluation_locally.sh: line 43: kill: (72357) - No such process
root@94d903ce99a4:/home/user/competition# INFO:minerl.env.malmo:Minecraft process psutil.Process(pid=77279, status=βterminatedβ) terminated with exit code None
INFO:minerl.env.malmo:Minecraft process psutil.Process(pid=77277, status=βterminatedβ) terminated with exit code None
^C
root@94d903ce99a4:/home/user/competition# ^C
root@94d903ce99a4:/home/user/competition# ps aux xvfb-run -s β-ac -screen 0 1280x1024x24β ./new/evaluation_locally.sh --verbose
error: unsupported option (BSD syntax)
Usage:
ps [options]
Try βps --help <simple|list|output|threads|misc|all>β
or βps --help <s|l|o|t|m|a>β
for additional help text.
For more details see ps(1).
root@94d903ce99a4:/home/user/competition# xvfb-run -s β-ac -screen 0 1280x1024x24β ./new/evaluation_locally.sh --verbose ps aux
Verifying (and downloading) MineRL datasetβ¦
If you do not want to use the data:
run the local evaluation scripts with --no-data
If you want to use your existing download of the data:
make sure your MINERL_DATA_ROOT is set.
Data directory is data
Data verified! A+!
Not starting broadcast server for localhost.
NS running on localhost:9090 (127.0.0.1)
Warning: HMAC key not set. Anyone can connect to this server!
URI = PYRO:Pyro.NameServer@localhost:9090
WARNING:ray.rllib.utils.compression:lz4 not available, disabling sample compression. This will significantly impact RLlib performance. To install lz4, run pip install lz4
.
2019-09-02 13:17:51,657 WARNING worker.py:1337 β WARNING: Not updating worker name since setproctitle
is not installed. Install this with pip install setproctitle
(or ray[debug]) to enable monitoring of worker processes.
2019-09-02 13:17:51,658 INFO node.py:498 β Process STDOUT and STDERR is being redirected to /tmp/ray/session_2019-09-02_13-17-51_658243_77480/logs.
2019-09-02 13:17:51,775 INFO services.py:409 β Waiting for redis server at 127.0.0.1:44695 to respondβ¦
2019-09-02 13:17:51,893 INFO services.py:409 β Waiting for redis server at 127.0.0.1:18180 to respondβ¦
2019-09-02 13:17:51,895 INFO services.py:806 β Starting Redis shard with 10.0 GB max memory.
2019-09-02 13:17:51,930 INFO node.py:512 β Process STDOUT and STDERR is being redirected to /tmp/ray/session_2019-09-02_13-17-51_658243_77480/logs.
2019-09-02 13:17:51,933 WARNING services.py:1298 β Warning: Capping object memory store to 20.0GB. To increase this further, specify object_store_memory
when calling ray.init() or ray start.
2019-09-02 13:17:51,933 WARNING services.py:1323 β WARNING: The object store is using /tmp instead of /dev/shm because /dev/shm has only 67108864 bytes available. This may slow down performance! You may be able to free up space by deleting files in /dev/shm or terminating any running plasma_store_server processes. If you are inside a Docker container, you may need to pass an argument with the flag ββshm-sizeβ to βdocker runβ.
2019-09-02 13:17:51,933 INFO services.py:1446 β Starting the Plasma object store with 20.0 GB memory using /tmp.
2019-09-02 13:17:52,183 WARNING logger.py:139 β Couldnβt import TensorFlow - disabling TensorBoard logging.
2019-09-02 13:17:52,185 WARNING logger.py:233 β Could not instantiate <class βray.tune.logger.TFLoggerβ> - skipping.
WARNING:ray.rllib.utils.compression:lz4 not available, disabling sample compression. This will significantly impact RLlib performance. To install lz4, run pip install lz4
.
INFO:minerl.env.malmo.instance.b4f065:Starting Minecraft process: [β/tmp/tmp7trapicr/Minecraft/launchClient.shβ, β-portβ, β9081β, β-envβ, β-runDirβ, β/tmp/tmp7trapicr/Minecraft/runβ]
INFO:minerl.env.malmo.instance.b4f065:Starting process watcher for process 82476 @ localhost:9081
Exception in thread Thread-1:
Traceback (most recent call last):
File β/root/anaconda3/lib/python3.6/threading.pyβ, line 916, in _bootstrap_inner
self.run()
File β/root/anaconda3/lib/python3.6/threading.pyβ, line 864, in run
self._target(*self._args, **self._kwargs)
File β/root/anaconda3/lib/python3.6/site-packages/minerl/env/malmo.pyβ, line 896, in keep_alive_pyro
InstanceManager.add_keep_alive(os.getpid(), callback)
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 275, in getattr
self._pyroGetMetadata()
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 615, in _pyroGetMetadata
self.__pyroCreateConnection()
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 588, in __pyroCreateConnection
uri = _resolve(self._pyroUri, self._pyroHmacKey)
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 1911, in _resolve
return nameserver.lookup(uri.object)
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 185, in call
return self.__send(self.__name, args, kwargs)
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 476, in _pyroInvoke
raise data # if you see this in your traceback, you should probably inspect the remote traceback as well
Pyro4.errors.NamingError: unknown name: minerl.instance_manager
Traceback (most recent call last):
File βrun.pyβ, line 2, in
import train
File β/home/user/competition/train.pyβ, line 14, in
from envs import diamond_env_creator
File β/home/user/competition/envs.pyβ, line 10, in
from hack import minerl
File β/home/user/competition/hack.pyβ, line 74, in
minerl.env.malmo.InstanceManager.get_instance = get_instance
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 291, in setattr
self._pyroGetMetadata()
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 615, in _pyroGetMetadata
self.__pyroCreateConnection()
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 588, in __pyroCreateConnection
uri = _resolve(self._pyroUri, self._pyroHmacKey)
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 1911, in _resolve
return nameserver.lookup(uri.object)
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 185, in call
return self.__send(self.__name, args, kwargs)
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 476, in _pyroInvoke
raise data # if you see this in your traceback, you should probably inspect the remote traceback as well
Pyro4.errors.NamingError: unknown name: minerl.instance_manager
Β±-- This exception occured remotely (Pyro) - Remote traceback:
| Traceback (most recent call last):
| File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/naming.pyβ, line 91, in lookup
| uri, metadata = self.storage[name]
| KeyError: βminerl.instance_managerβ
|
| During handling of the above exception, another exception occurred:
|
| Traceback (most recent call last):
| File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 1421, in handleRequest
| data = method(*vargs, **kwargs) # this is the actual method call to the Pyro object
| File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/naming.pyβ, line 98, in lookup
| raise NamingError("unknown name: " + name)
| Pyro4.errors.NamingError: unknown name: minerl.instance_manager
Β±-- End of remote traceback
./new/evaluation_locally.sh: line 43: kill: (77557) - No such process
./new/evaluation_locally.sh: line 44: 77479 Terminated pyro4-ns
root@94d903ce99a4:/home/user/competition# INFO:minerl.env.malmo:Minecraft process psutil.Process(pid=82478, status=βterminatedβ) terminated with exit code None
INFO:minerl.env.malmo:Minecraft process psutil.Process(pid=82476, status=βterminatedβ) terminated with exit code None
@shivam
![](https://images.aicrowd.com/100x100/images/participants/image_file/default/2.png)
Problems about the competition startkit
About 5 years agoIt can run in a docker envinment when I use xvfb-run -s "-ac -screen 0 1280x1024x24" python train.py ' But I get the following error when I use the script in competiton startkit repo, I use the bash
xvfb-run -s β-ac -screen 0 1280x1024x24β ./utility/evaluate_locally.sh`, it will get the following error:
Traceback (most recent call last):
File β/root/anaconda3/lib/python3.6/threading.pyβ, line 916, in _bootstrap_inner
self.run()
File β/root/anaconda3/lib/python3.6/threading.pyβ, line 864, in run
self._target(*self._args, **self._kwargs)
File β/root/anaconda3/lib/python3.6/site-packages/minerl/env/malmo.pyβ, line 896, in keep_alive_pyro
InstanceManager.add_keep_alive(os.getpid(), callback)
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 275, in getattr
self._pyroGetMetadata()
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 615, in _pyroGetMetadata
self.__pyroCreateConnection()
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 588, in __pyroCreateConnection
uri = _resolve(self._pyroUri, self._pyroHmacKey)
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 1911, in _resolve
return nameserver.lookup(uri.object)
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 185, in call
return self.__send(self.__name, args, kwargs)
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 476, in _pyroInvoke
raise data # if you see this in your traceback, you should probably inspect the remote traceback as well
Pyro4.errors.NamingError: unknown name: minerl.instance_manager
Traceback (most recent call last):
File βrun.pyβ, line 2, in
import train
File β/home/user/competition/train.pyβ, line 14, in
from envs import diamond_env_creator
File β/home/user/competition/envs.pyβ, line 10, in
from hack import minerl
File β/home/user/competition/hack.pyβ, line 74, in
minerl.env.malmo.InstanceManager.get_instance = get_instance
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 291, in setattr
self._pyroGetMetadata()
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 615, in _pyroGetMetadata
self.__pyroCreateConnection()
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 588, in __pyroCreateConnection
uri = _resolve(self._pyroUri, self._pyroHmacKey)
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 1911, in _resolve
return nameserver.lookup(uri.object)
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 185, in call
return self.__send(self.__name, args, kwargs)
File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 476, in _pyroInvoke
raise data # if you see this in your traceback, you should probably inspect the remote traceback as well
Pyro4.errors.NamingError: unknown name: minerl.instance_manager
Β±-- This exception occured remotely (Pyro) - Remote traceback:
| Traceback (most recent call last):
| File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/naming.pyβ, line 91, in lookup
| uri, metadata = self.storage[name]
| KeyError: βminerl.instance_managerβ
|
| During handling of the above exception, another exception occurred:
|
| Traceback (most recent call last):
| File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/core.pyβ, line 1421, in handleRequest
| data = method(*vargs, **kwargs) # this is the actual method call to the Pyro object
| File β/root/anaconda3/lib/python3.6/site-packages/Pyro4/naming.pyβ, line 98, in lookup
| raise NamingError("unknown name: " + name)
| Pyro4.errors.NamingError: unknown name: minerl.instance_manager
![](https://images.aicrowd.com/100x100/images/participants/image_file/default/2.png)
What should i do when submitting 20 times, can I change a account?
About 5 years agoSubmission often goes wrong, we have to submit many times to debug it.
About the submission content
About 5 years agoSame Problem, we can wait for the official responseβ¦