How often does YARN purge locally cached resources?

If you are stretched for space locally, this may come in handy. By default, localized resources are purged every ten minutes…

[root@cmhlddlkedat01 2.2.4.2-2]# grep -A1 yarn.nodemanager.localizer.cache.cleanup.interval-ms yarn-default.xml
    yarn.nodemanager.localizer.cache.cleanup.interval-ms
    600000
[root@cmhlddlkedat01 2.2.4.2-2]#

Of course, this can be overridden.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.