DF activities at NIIFI - HBONE+ development of the academic and research network in Hungary Amsterdam, 09.11.2010 TF-MSP meeting János Mohácsi NIIF/Hungarnet
Outline NIIF program and service structure NDP (ÚMFT) projects of NIIF the HBONE+ project! Past experiences with DF leasing/rental attempts! Network development of HBONE+ project 2. oldal
Services and development areas of NIIF/Hungarnet Network: HBONE, IPv6, VPN, multicast Middleware: eduid, CA/TCS, eduroam HPC: Supercomputing, grid, storage Applications: Collaborative: Basic +Value added: Videoconferencing, VoIP, Video-on-Demand webhosting, mail, Hungarian Electronic Library, MOKKA, Subject Gateway (SZEZÁM) 3.
Pre DF Network infrastructure - HBONE 4.
NIIFI participation in NDP2 TÁMOP 4.1.3 Service development TIOP 1.3.2 KMOP 4.2.1(A_2) Infrastructure development Convergence regions Central Hungary region HBONE+ project: June 2009 - December 2011 NDP2/ÚMFT projects TIOP-1.3.2-08/1-2009-0001 and KMOP-4.2.1/A_2-2009-0001 Support: ~4.2 MdFt (~ 14 meur) TÁMOP 4.1.3: May 2008 October 2010 Support: ~560 mft (~ 1.5 meur) 5. oldal
HBONE+ network Hybrid network infrastructure! Dark fibre! DWDM service VOPN / dynamic lambda allocation " Supporting alien wavelengths to universities! Backbone routers Flexible IP/MPLS Metro Ethernet Extension of distribution network! Licensed Microwave systems - 34-200 Mbps 6. oldal
HBONE+ network/2 National coverage of dark fiber ~ 90% DWDM Router! Installation in progress Extension of the distribution network! Ceragon FibAir Microwave systems - 34-200 Mbps! Locations: Esztergom, Pannonhalma, Pápa, Kalocsa, Gyula, Békéscsaba, Sopron, Piszkéstet! Provide more useful and up-to-date information to universities! User Portal/helpdesk AAI integration! Service management (including most of the services)! SLA reporting! Databases similar to GN2 I-SHARe 7. oldal
HBONE+ middleware Virtualised AAI services for smaller institutions Supporting federated authentication and authorisation European eduroam/ edugain compatibility Eduroam! 20 large universities HREF Hungarian Research and Education Federation /eduid! 13 large universities Home institute Federation Trust Service 8. oldal
HBONE+ HPC Supercomputing:! 3 universities (Debrecen, Szeged,Pécs) + NIIFI center! NUMA and cluster systems! Dedicated network capacity between the centers! min. 3 x 8-16 Tflops + NIIFI (2 TFlops)! National research and academic usage! Software stack: " LRMS, HPC libraries " programming environments, compilers, debuggers, profilers! National + European integration (EGEE, KnowARC, DEISA, PRACE) Storage:! 2 further universities! Dunaújváros, Sopron! national storage grid! initially min. 0.5 PByte capacity 9. oldal
HBONE+ HPC/2 HPC environment under preparation! Debrecen, Szeged, Pécs Supercomputers! Contracted Storage! Flexible Ethernet based solution Fujitsu Ethernus! 500 TByte cloud storage ready to be used Services! Cloud = distributed resource mgmt + virtualisation! Provide cloud computing services to universities! Strorage grid/cloud services for off-site backup! Web portal services to access (HPC/storage) grid services 10. oldal
HBONE+ collaboration Videoconferencing! 30+2 fullhd VC room systems installed at the universities! Centrally manageable SIP/ H.323, fullhd MCU! Desktop videoconferencing system Integrated with the existing videoconferencing system of NIIF/Hungarnet VOIP! Upgrading the existing Voice gateways! Supporting deployment of IP PBX systems 11. oldal
HBONE+ collaboration HD Videoconferencing! 30 x Polycom HDX 8000 + Polycom RMX 4000 MCU + management! Installed and ready to be used Desktop videoconferencing systems! Vidyo Router/Gateway/Portal! Installed (testing in progress) VoIP Upgrading the existing Voice gateways! 35 x Cisco 2811 Voice bundle replacing old Cisco 5350s 12. oldal
Past experience of DF rental attempts 1997-2000! DF offers price below STM-1 rentals for 5 years! NIIF/Hungarnet was not ready for using DF 2001-2003! DF offers only in and around Budapest we started to use them 2004-2005! We asked explicitly DF/Lit Fibre/STM-16/10GE DF about 2x price of 10GE 2008-2009! After informal discussions with the Telcos we expected 80-90% coverage of Hungary with similar price to previous tender! Tender result with 1.5 years provisioning time " DF price about 10x of single 10GE Telcos realised: no more fibres " No competition just 3 country-wide providers (1-2 offers per regions) " No offer for 10-15 Year IRU, only 5 years rental " Failure 13. oldal
Current experience with DF Re-negotiation with all Telcos! Lack of fiber only 3 country-wide providers " Incumbent DF available ~ 10x10G price " Alternative inefficient usage of fibres, extensive traffic engineering needed " Electricity company limited capacity in OPGW, far from cities! Expensive to lease dark fibre! You don t need all capacity which become available! Sharing/cooperation Proposal - Hungarian Electricity Company! Shared usage of fibre - share the DWDM resources on lambda basis! NIIF/Hungarnet buy and operate the DWDM system! HEC uses the alien wavelengths! HEC provides equipment housing 14. oldal
Technical details of proposal Framework contract (8 years) with IRU! 90% coverage of Hungary ~ 3000 km fibre! Shared usage in C-Band - at least 40" on fibre-pairs! Lambdas are engineered to support 40G, maybe 100G also! Housing locations in every ~80-100 km! Two partners shared view to the entire network - shared mgmt system! Two mgmt domains to maintain own lambdas 15.
HBONE+ network coverage 16
HBONE+ network coverage /2 Cable types backbone is OPGW! ITU-T G.652B / G.652D! Coverage: 79 PoPs, ~3200 Km Challenges! Redundant fibre path between the core PoPs L1 and L3 point of view! Separate tenders for local-loop DFs done on time delivery?! Housing requirements before finishing the DWDM equipment tender! PMD on OPGW 17.
Tender results Process: competitive negotiation (together with L3 equipments) 2010 February-August 10 equipment vendors DWDM Equipment - Alcatel-Lucent PSS-1830! 80 channel system with 40 channel licensed! Engineered for 40G/100G capability, Only EDFA amplifiers, distance up to 1000 km! Mostly 10GE lambdas, some 40G lambda used in the system with muxponders! WSS ROADMs + terminal multiplexers + Colorless/Tunable Transponders! No optical restoration but free channel capacity to reroute "! Device managed by NIIF/Hungarnet with maintenance contract for long period IP/MPLS Equipment Cisco ASR9000 series routers! MEF Carrier Ethernet/MPLS SP Platform! 92 (184) Gbps slot capacity! Cisco IOS-XR Modular OS! Green design! Device managed by NIIF/Hungarnet with maintenance contract for long period 18.
Hybrid Network Services - development Lightpath Service! Dedicated Network capacity for projects " already 3 demands! Point-to-point circuits "od L2 VPN, managed Ethernet - Finegrained capacity provisioning with routers Traditional IP: IPv4/6, unicast/ multicast, L3 VPN, with QoS and SLA 19.
Conclusions and remarks/lessons Todo! Deploy the DWDM and IP network! Develop lightpath/alien wavelength/more finer granular bandwidth service! Overcome limitations of DWDM management systems " Two operating entity systems " Operational models for dynamic wavelength handling " Test and research activity on the DWDM platform could effect other working wavelength and services? procedures? " Common documentation? " Vendor communication?! Cross Border Fiber extension? next to AMRES Remarks/lessons! No unique way to acquire DF! Dealing with fiber providers can be challenging! Try to find local providers to get competitive prices! Development fund might be available for CAPEX! KISS 20.
Questions? Mohácsi János mohacsi@niif.hu net-admin@niif.hu