Out of Space Issue

Thank you very much! It works!

View post 0

Out of Space Issue

We only have 10G in the linux virtual machine under /home

And conda iteself takes 5.6G.

So, it is very easy to use all the space. Any way to work around it or can we request more space?

View post 1

Submission Script Bug: Failed if assets director has subdirectory

Thanks. I found the error.

I changed the “# Submit to AIcrowd” to “### Submit to AIcrowd”

Which caused the submission notebook recurision.

View post 0

Submission Script Bug: Failed if assets director has subdirectory

The submission script will create submission subfolder forever until all disk space is exhausted.

To reproducce

create the following director and then submit

• assets/
  • model1/
    -model1.pkl
    -model2/
    -model2.pkl
    learner.pkl

View post 1

Submission Error: Operation not permitted

Never mind. Looks like there are errors in my notebook. The dependency is removed after the notebook splits to train, test.

View post 3

Submission Error: Operation not permitted

OS: #41~18.04.1-Ubuntu SMP Mon Jan 18 14:00:01 UTC 2021
Python 3.8.5

Error message is below:

Using notebook: /home/desktop0/files/baseline.ipynb for submission…
Removing existing files from submission directory…
Scrubbing API keys from the notebook…
Collecting notebook…
╭───────────────────── Traceback (most recent call last) ──────────────────────╮
│ /home/desktop0/conda/bin/aicrowd:8 in │
│ │
│ 5 from aicrowd.cli import cli │
│ 6 if name == ‘main’: │
│ 7 │ sys.argv[0] = re.sub(r’(-script.pyw|.exe)?$’, ‘’, sys.argv[0]) │
│ ❱ 8 │ sys.exit(cli()) │
│ │
│ /home/desktop0/conda/lib/python3.8/site-packages/click/core.py:829 in │
│ call │
│ │
│ 826 │ │
│ 827 │ def call(self, *args, **kwargs): │
│ 828 │ │ “”“Alias for :meth:main.”"" │
│ ❱ 829 │ │ return self.main(*args, **kwargs) │
│ 830 │
│ 831 │
│ 832 class Command(BaseCommand): │
│ │
│ /home/desktop0/conda/lib/python3.8/site-packages/click/core.py:782 in main │
│ │
│ 779 │ │ try: │
│ 780 │ │ │ try: │
│ 781 │ │ │ │ with self.make_context(prog_name, args, **extra) as c │
│ ❱ 782 │ │ │ │ │ rv = self.invoke(ctx) │
│ 783 │ │ │ │ │ if not standalone_mode: │
│ 784 │ │ │ │ │ │ return rv │
│ 785 │ │ │ │ │ # it’s not safe to ctx.exit(rv) here! │
│ │
│ /home/desktop0/conda/lib/python3.8/site-packages/click/core.py:1259 in │
│ invoke │
│ │
│ 1256 │ │ │ │ Command.invoke(self, ctx) │
│ 1257 │ │ │ │ sub_ctx = cmd.make_context(cmd_name, args, parent=ctx │
│ 1258 │ │ │ │ with sub_ctx: │
│ ❱ 1259 │ │ │ │ │ return _process_result(sub_ctx.command.invoke(sub │
│ 1260 │ │ │
│ 1261 │ │ # In chain mode we create the contexts step by step, but afte │
│ 1262 │ │ # base command has been invoked. Because at that point we do │
│ │
│ /home/desktop0/conda/lib/python3.8/site-packages/click/core.py:1259 in │
│ invoke │
│ │
│ 1256 │ │ │ │ Command.invoke(self, ctx) │
│ 1257 │ │ │ │ sub_ctx = cmd.make_context(cmd_name, args, parent=ctx │
│ 1258 │ │ │ │ with sub_ctx: │
│ ❱ 1259 │ │ │ │ │ return _process_result(sub_ctx.command.invoke(sub │
│ 1260 │ │ │
│ 1261 │ │ # In chain mode we create the contexts step by step, but afte │
│ 1262 │ │ # base command has been invoked. Because at that point we do │
│ │
│ /home/desktop0/conda/lib/python3.8/site-packages/click/core.py:1066 in │
│ invoke │
│ │
│ 1063 │ │ “”" │
│ 1064 │ │ _maybe_show_deprecated_notice(self) │
│ 1065 │ │ if self.callback is not None: │
│ ❱ 1066 │ │ │ return ctx.invoke(self.callback, **ctx.params) │
│ 1067 │
│ 1068 │
│ 1069 class MultiCommand(Command): │
│ │
│ /home/desktop0/conda/lib/python3.8/site-packages/click/core.py:610 in invoke │
│ │
│ 607 │ │ args = args[2:] │
│ 608 │ │ with augment_usage_errors(self): │
│ 609 │ │ │ with ctx: │
│ ❱ 610 │ │ │ │ return callback(*args, **kwargs) │
│ 611 │ │
│ 612 │ def forward(*args, **kwargs): # noqa: B902 │
│ 613 │ │ “”“Similar to :meth:invoke but fills in default keyword │
│ │
│ /home/desktop0/conda/lib/python3.8/site-packages/aicrowd/cmd/notebook.py:101 │
│ in submit_subcommand │
│ │
│ 98 │ from aicrowd.notebook.submit import create_submission │
│ 99 │ │
│ 100 │ try: │
│ ❱ 101 │ │ create_submission( │
│ 102 │ │ │ challenge, │
│ 103 │ │ │ description, │
│ 104 │ │ │ assets_dir, │
│ │
│ /home/desktop0/conda/lib/python3.8/site-packages/aicrowd/notebook/submit.py: │
│ 87 in create_submission │
│ │
│ 84 │ no_verify: bool = False, │
│ 85 │ dry_run: bool = False, │
│ 86 ): │
│ ❱ 87 │ bundle_submission(assets_dir, submission_zip_path, notebook_name) │
│ 88 │ if not no_verify: │
│ 89 │ │ verify_submission() │
│ 90 │ if not dry_run: │
│ │
│ /home/desktop0/conda/lib/python3.8/site-packages/aicrowd/notebook/submit.py: │
│ 73 in bundle_submission │
│ │
│ 70 │ # Copy the original notebook │
│ 71 │ # bundle_notebook(submission_zip_path, notebook_name) │
│ 72 │ # Copy assets │
│ ❱ 73 │ shutil.copytree(assets_dir, os.path.join(SUBMISSION_DIR, assets_dir │
│ 74 │ # Zip everything │
│ 75 │ shutil.make_archive(submission_zip_path.replace(”.zip", “”), “zip”, │
│ │
│ /home/desktop0/conda/lib/python3.8/shutil.py:554 in copytree │
│ │
│ 551 │ sys.audit(“shutil.copytree”, src, dst) │
│ 552 │ with os.scandir(src) as itr: │
│ 553 │ │ entries = list(itr) │
│ ❱ 554 │ return _copytree(entries=entries, src=src, dst=dst, symlinks=syml │
│ 555 │ │ │ │ │ ignore=ignore, copy_function=copy_function, │
│ 556 │ │ │ │ │ ignore_dangling_symlinks=ignore_dangling_symlink │
│ 557 │ │ │ │ │ dirs_exist_ok=dirs_exist_ok) │
│ │
│ /home/desktop0/conda/lib/python3.8/shutil.py:510 in _copytree │
│ │
│ 507 │ │ if getattr(why, ‘winerror’, None) is None: │
│ 508 │ │ │ errors.append((src, dst, str(why))) │
│ 509 │ if errors: │
│ ❱ 510 │ │ raise Error(errors) │
│ 511 │ return dst │
│ 512 │
│ 513 def copytree(src, dst, symlinks=False, ignore=None, copy_function=cop │
╰──────────────────────────────────────────────────────────────────────────────╯
Error: [(‘assets/model.zip’, ‘/files/submission/assets/model.zip’, ‘[Errno 1]
Operation not permitted’), (‘assets’, ‘/files/submission/assets’, ‘[Errno 1]
Operation not permitted’)]

View post 0