You can still use S3 even without being on AWS, though for more reasonable (< 1TB) amounts of data, old school local storage served by Nginx does the trick.

For SNS, what does it offer that RabbitMQ doesn't? I've always found RMQ to be rock-solid and wouldn't use SNS anyway.