{ "access": { "embargo": { "active": false, "reason": null }, "files": "public", "record": "public", "status": "open" }, "created": "2021-06-23T05:24:36.085561+00:00", "custom_fields": { "meeting:meeting": { "acronym": "MICCAI", "dates": "September 21 - October 1, 2021", "title": "Medical Image Computing and Computer Assisted Intervention", "url": "http://www.miccai.org/" } }, "deletion_status": { "is_deleted": false, "status": "P" }, "files": { "count": 6, "enabled": true, "entries": { "latest_net_G_A.pth": { "checksum": "md5:89fdaff117688717a6929756214e31ed", "ext": "pth", "id": "ee257459-fcb3-4d91-ac31-3745b61986d5", "key": "latest_net_G_A.pth", "metadata": null, "mimetype": "application/octet-stream", "size": 71094404 }, "latest_net_G_AC.pth": { "checksum": "md5:b48f385700a208ac0b387c5bbbd98813", "ext": "pth", "id": "f730bc72-87f2-4948-83f5-ef33abdce953", "key": "latest_net_G_AC.pth", "metadata": null, "mimetype": "application/octet-stream", "size": 71094332 }, "latest_net_G_B.pth": { "checksum": "md5:8eb96f11c002534a7d7b66d02512f691", "ext": "pth", "id": "ef048105-5860-41ae-ab38-5a5410b01b9b", "key": "latest_net_G_B.pth", "metadata": null, "mimetype": "application/octet-stream", "size": 71094248 }, "latest_net_G_BC.pth": { "checksum": "md5:78d8fffd08ca088da023baba880b2cfa", "ext": "pth", "id": "44d802c6-9105-41bf-8096-93cff8c0347d", "key": "latest_net_G_BC.pth", "metadata": null, "mimetype": "application/octet-stream", "size": 71094400 }, "unc_vids.zip": { "checksum": "md5:2f4414b9b1e3738acd56a0be36a57c27", "ext": "zip", "id": "15cc5627-895f-4463-8ac4-300505ffb46e", "key": "unc_vids.zip", "metadata": null, "mimetype": "application/zip", "size": 11006153 }, "vr_caps.zip": { "checksum": "md5:ff81c6fa58e42dbb8b7d42ac283ffda9", "ext": "zip", "id": "e531f98b-011a-4051-9172-510e88aa9609", "key": "vr_caps.zip", "metadata": null, "mimetype": "application/zip", "size": 11866099 } }, "order": [], "total_bytes": 307249636 }, "id": "4993651", "is_draft": false, "is_published": true, "links": { "access": "https://zenodo.org/api/records/4993651/access", "access_links": "https://zenodo.org/api/records/4993651/access/links", "access_request": "https://zenodo.org/api/records/4993651/access/request", "access_users": "https://zenodo.org/api/records/4993651/access/users", "archive": "https://zenodo.org/api/records/4993651/files-archive", "archive_media": "https://zenodo.org/api/records/4993651/media-files-archive", "communities": "https://zenodo.org/api/records/4993651/communities", "communities-suggestions": "https://zenodo.org/api/records/4993651/communities-suggestions", "doi": "https://doi.org/10.5281/zenodo.4993651", "draft": "https://zenodo.org/api/records/4993651/draft", "files": "https://zenodo.org/api/records/4993651/files", "latest": "https://zenodo.org/api/records/4993651/versions/latest", "latest_html": "https://zenodo.org/records/4993651/latest", "media_files": "https://zenodo.org/api/records/4993651/media-files", "parent": "https://zenodo.org/api/records/4993650", "parent_doi": "https://zenodo.org/doi/10.5281/zenodo.4993650", "parent_html": "https://zenodo.org/records/4993650", "requests": "https://zenodo.org/api/records/4993651/requests", "reserve_doi": "https://zenodo.org/api/records/4993651/draft/pids/doi", "self": "https://zenodo.org/api/records/4993651", "self_doi": "https://zenodo.org/doi/10.5281/zenodo.4993651", "self_html": "https://zenodo.org/records/4993651", "self_iiif_manifest": "https://zenodo.org/api/iiif/record:4993651/manifest", "self_iiif_sequence": "https://zenodo.org/api/iiif/record:4993651/sequence/default", "versions": "https://zenodo.org/api/records/4993651/versions" }, "media_files": { "count": 0, "enabled": false, "entries": {}, "order": [], "total_bytes": 0 }, "metadata": { "creators": [ { "affiliations": [ { "name": "Stony Brook University" } ], "person_or_org": { "family_name": "Shawn Mathew", "name": "Shawn Mathew", "type": "personal" } }, { "affiliations": [ { "name": "Memorial Sloan Kettering" } ], "person_or_org": { "family_name": "Saad Nadeem", "name": "Saad Nadeem", "type": "personal" } }, { "affiliations": [ { "name": "Stony Brook University" } ], "person_or_org": { "family_name": "Arie Kaufman", "name": "Arie Kaufman", "type": "personal" } } ], "description": "
Abstract:
\n\nHaustral folds are colon wall protrusions implicated for highpolyp miss rate during optical colonoscopy procedures. If segmented ac-curately, haustral folds can allow for better estimation of missed surfaceand can also serve as valuable landmarks for registering pre-treatmentvirtual (CT) and optical colonoscopies, to guide navigation towards theanomalies found in pre-treatment scans. We present a novel generativeadversarial network, FoldIt, for feature-consistent image translation ofoptical colonoscopy videos to virtual colonoscopy renderings with haus-tral fold overlays. A new transitive loss is introduced in order to leverageground truth information between haustral fold annotations and virtualcolonoscopy renderings. We demonstrate the effectiveness of our modelon real challenging optical colonoscopy videos as well as on texturedvirtual colonoscopy videos with clinician-verified haustral fold annota-tions. All code and scripts to reproduce the experiments of this paper will be made available via our Computational Endoscopy Platform at https://github.com/nadeemlab/CEP
\n\n\n\n
Model Weights for FoldIt
\n\nThis was trained where domain A is optical colonoscopy, domain B is haustral fold annotation and domain C is virtual colonoscopy ground truth corresponding to the haustral fold annotations.
\n\nTesting Videos
\n\nThe frames that were used for testing are included as well. Please cite the appropriate papers when using them.
\n\n\n\n\nIncetan, K., Celik, I.O., Obeid, A., Gokceler, G.I., Ozyoruk, K.B., Almalioglu,Y., Chen, R.J., Mahmood, F., Gilbert, H., Durr, N.J., et al.: VR-Caps: A virtualenvironment for capsule endoscopy. Medical Image Analysis. p. 101990 (2021)
\n
\n", "publication_date": "2021-09-27", "publisher": "Zenodo", "resource_type": { "id": "publication-conferencepaper", "title": { "de": "Konferenzbeitrag", "en": "Conference paper" } }, "rights": [ { "description": { "en": "The Creative Commons Attribution license allows re-distribution and re-use of a licensed work on the condition that the creator is appropriately credited." }, "icon": "cc-by-icon", "id": "cc-by-4.0", "props": { "scheme": "spdx", "url": "https://creativecommons.org/licenses/by/4.0/legalcode" }, "title": { "en": "Creative Commons Attribution 4.0 International" } } ], "title": "FoldIt: Haustral Folds Detection and Segmentation in Colonoscopy Videos" }, "parent": { "access": { "owned_by": { "user": 235776 } }, "communities": {}, "id": "4993650", "pids": { "doi": { "client": "datacite", "identifier": "10.5281/zenodo.4993650", "provider": "datacite" } } }, "pids": { "doi": { "client": "datacite", "identifier": "10.5281/zenodo.4993651", "provider": "datacite" }, "oai": { "identifier": "oai:zenodo.org:4993651", "provider": "oai" } }, "revision_id": 3, "stats": { "all_versions": { "data_volume": 13946748707.0, "downloads": 296, "unique_downloads": 138, "unique_views": 324, "views": 371 }, "this_version": { "data_volume": 13946748707.0, "downloads": 296, "unique_downloads": 138, "unique_views": 322, "views": 369 } }, "status": "published", "updated": "2021-09-22T20:14:55.593281+00:00", "versions": { "index": 1, "is_latest": true } }Ma, R., Wang, R., Pizer, S., Rosenman, J., McGill, S.K., Frahm, J.M.: Real-time3D reconstruction of colonoscopic surfaces for determining missing regions. Inter-national Conference on Medical Image Computing and Computer-Assisted Inter-vention pp. 573–582 (2019)
\n