Yes, go. You could explain to the organizers that you are working on getting comfortable in this area and ask that they respect that. It seems like the type of person to organize and implement a thing like this would be a kind and understanding person. Going is a good way to face your fear head-on. And you can work on the background and reasons why you continue to hit this block.
My friend, read your sig!