Fix cached materials not being cleared when unloading the resource