Fury was in outer space so it's safe to say he was gone the whole time as this seemed to only take place over a few days. the task was supposed to be simple.