WA Police are on the hunt for a 37-year-old man who removed his ankle monitoring device on Thursday afternoon.