Changed url key of product does not change in product grid in admin?

Magento 2.4.6-p4

I am chaning the url key by using

$product->setUrlKey('newkey1234');
$product->save();

Now, when I view this product in admin, it still shows the old url key. Loading the product and printing the url key shows the new key:

var_dump($product->getUrlKey());

So, how can I also make it change in admin?

Thanks!